-- Logs begin at Wed 2022-06-08 01:08:32 UTC, end at Wed 2022-06-08 02:26:39 UTC. -- Jun 08 01:56:12.224293 dv-cinder-845069-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 08 01:56:12.231709 dv-cinder-845069-1-iscsi devstack@n-api.service[103493]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 08 01:56:12.233759 dv-cinder-845069-1-iscsi devstack@n-api.service[103493]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 8 01:56:12 2022] *** Jun 08 01:56:12.233759 dv-cinder-845069-1-iscsi devstack@n-api.service[103493]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 08 01:56:12.233759 dv-cinder-845069-1-iscsi devstack@n-api.service[103493]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 08 01:56:12.233759 dv-cinder-845069-1-iscsi devstack@n-api.service[103493]: nodename: dv-cinder-845069-1-iscsi Jun 08 01:56:12.233759 dv-cinder-845069-1-iscsi devstack@n-api.service[103493]: machine: x86_64 Jun 08 01:56:12.233759 dv-cinder-845069-1-iscsi devstack@n-api.service[103493]: clock source: unix Jun 08 01:56:12.233759 dv-cinder-845069-1-iscsi devstack@n-api.service[103493]: pcre jit disabled Jun 08 01:56:12.234250 dv-cinder-845069-1-iscsi devstack@n-api.service[103493]: detected number of CPU cores: 4 Jun 08 01:56:12.234250 dv-cinder-845069-1-iscsi devstack@n-api.service[103493]: current working directory: / Jun 08 01:56:12.234250 dv-cinder-845069-1-iscsi devstack@n-api.service[103493]: detected binary path: /usr/bin/uwsgi-core Jun 08 01:56:12.234250 dv-cinder-845069-1-iscsi devstack@n-api.service[103493]: your processes number limit is 47680 Jun 08 01:56:12.234250 dv-cinder-845069-1-iscsi devstack@n-api.service[103493]: your memory page size is 4096 bytes Jun 08 01:56:12.234250 dv-cinder-845069-1-iscsi devstack@n-api.service[103493]: detected max file descriptor number: 2048 Jun 08 01:56:12.234250 dv-cinder-845069-1-iscsi devstack@n-api.service[103493]: lock engine: pthread robust mutexes Jun 08 01:56:12.234250 dv-cinder-845069-1-iscsi devstack@n-api.service[103493]: thunder lock: enabled Jun 08 01:56:12.234250 dv-cinder-845069-1-iscsi devstack@n-api.service[103493]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 08 01:56:12.234250 dv-cinder-845069-1-iscsi devstack@n-api.service[103493]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 08 01:56:12.280614 dv-cinder-845069-1-iscsi devstack@n-api.service[103493]: Python main interpreter initialized at 0x56066fae69c0 Jun 08 01:56:12.280614 dv-cinder-845069-1-iscsi devstack@n-api.service[103493]: python threads support enabled Jun 08 01:56:12.280614 dv-cinder-845069-1-iscsi devstack@n-api.service[103493]: your server socket listen backlog is limited to 100 connections Jun 08 01:56:12.280614 dv-cinder-845069-1-iscsi devstack@n-api.service[103493]: your mercy for graceful operations on workers is 90 seconds Jun 08 01:56:12.281004 dv-cinder-845069-1-iscsi devstack@n-api.service[103493]: mapped 403077 bytes (393 KB) for 2 cores Jun 08 01:56:12.281084 dv-cinder-845069-1-iscsi devstack@n-api.service[103493]: *** Operational MODE: preforking *** Jun 08 01:56:12.281339 dv-cinder-845069-1-iscsi devstack@n-api.service[103493]: *** uWSGI is running in multiple interpreter mode *** Jun 08 01:56:12.281339 dv-cinder-845069-1-iscsi devstack@n-api.service[103493]: spawned uWSGI master process (pid: 103493) Jun 08 01:56:12.281550 dv-cinder-845069-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 08 01:56:12.282393 dv-cinder-845069-1-iscsi devstack@n-api.service[103493]: spawned uWSGI worker 1 (pid: 103494, cores: 1) Jun 08 01:56:12.282501 dv-cinder-845069-1-iscsi devstack@n-api.service[103493]: spawned uWSGI worker 2 (pid: 103495, cores: 1) Jun 08 01:56:12.284470 dv-cinder-845069-1-iscsi devstack@n-api.service[103493]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 08 01:56:13.508340 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 08 01:56:13.537685 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 08 01:56:14.231230 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 08 01:56:14.231230 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: from cryptography.utils import int_from_bytes Jun 08 01:56:14.231470 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 08 01:56:14.231470 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: from cryptography.utils import int_from_bytes Jun 08 01:56:14.234076 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 08 01:56:14.234076 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: from cryptography.utils import int_from_bytes Jun 08 01:56:14.234419 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 08 01:56:14.234419 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: from cryptography.utils import int_from_bytes Jun 08 01:56:16.783447 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 08 01:56:16.784200 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 08 01:56:16.784576 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 08 01:56:16.784664 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 08 01:56:16.784664 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 08 01:56:16.784837 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 08 01:56:16.784837 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 08 01:56:16.784982 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 08 01:56:16.785078 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 08 01:56:16.785169 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 08 01:56:16.785306 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.785399 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.785628 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.785722 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.785950 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.786036 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.786269 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.786359 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.786619 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.786714 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.787170 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.787270 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.787497 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.787592 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.787814 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.787907 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.788144 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.788241 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.788416 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.788506 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.788742 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.788867 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.789067 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845069-1-iscsi {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.789155 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845069-1-iscsi {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.789393 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.789502 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.789698 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.789802 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.790009 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.790103 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.790324 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.790417 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.790628 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.790724 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.790948 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.791035 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.791252 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.791338 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.791752 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.792150 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.792301 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.792454 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.792570 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.792677 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.792796 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.792911 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.793118 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.793235 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.793433 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.793572 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.793741 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.793881 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.794058 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.794185 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.794364 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.794503 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.794683 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.794817 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.794992 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.795119 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.795388 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845069-1-iscsi {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.795518 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845069-1-iscsi {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.795702 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.795845 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.796013 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.796140 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.796324 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.796484 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.796776 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.796931 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.797060 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.797191 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.797370 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.797591 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.797720 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.797855 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.797989 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.798113 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.798303 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.798439 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.799231 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.799362 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.799559 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.799700 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.799883 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.800022 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.800206 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.800343 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.800535 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.800680 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.800848 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.800986 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.801158 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.801287 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.801475 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.801616 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.801781 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.801909 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.802089 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.802223 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.802359 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.802495 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.802620 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.802744 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.802946 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.803084 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.803269 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.803410 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.803592 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.803730 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.803866 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.803992 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.804127 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.804266 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.804427 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.804555 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.804722 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.804866 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.805033 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.805170 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.805340 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.805466 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.805646 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.805783 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.805952 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.806079 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.806259 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.806395 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.806568 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.806706 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.806871 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.806999 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.807179 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.807318 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.807501 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.807638 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.807814 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.807940 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.808137 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.808274 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.808456 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.808599 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.808779 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.808908 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.809176 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.809305 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.809438 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.809566 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.809720 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.809848 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.810057 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.810192 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.810375 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.810513 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.810683 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.810809 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.811001 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.811128 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.811319 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.811455 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.811626 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.811754 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.811930 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.812064 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.812235 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.812363 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.812578 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.812705 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.812905 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.813045 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.813209 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.813336 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.813467 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.813591 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.813750 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.813893 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.814053 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.814196 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.814432 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.814560 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.814742 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.814880 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.815049 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.815185 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.815358 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.815487 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.815661 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.815803 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.815968 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.816097 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.816276 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.816461 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.816601 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.816728 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.816900 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.817029 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.817206 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.817334 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.817513 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.817650 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.817818 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.817946 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.818122 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.818258 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.818428 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.818563 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.818745 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.818874 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.819062 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.819189 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.819369 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.819496 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.819673 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.819801 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.819977 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.820119 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.820281 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.820440 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.820625 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.820767 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.820932 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.821058 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.821236 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.821372 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.821558 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.821723 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.821857 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.821989 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.822157 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.822288 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.822475 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.822611 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.822781 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.822910 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.823087 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.823216 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.823404 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.823531 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.823704 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.823841 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.824010 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.824137 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.824327 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.824487 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.824657 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.824865 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.824994 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.825117 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.825240 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.825363 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.825545 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.825692 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.825849 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.825976 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.826155 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.826282 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.826458 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.826595 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.826763 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.826891 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.827064 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.827192 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.827381 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.827529 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.827742 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.827859 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.828014 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.828150 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.828322 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.828504 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.828654 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.828789 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.828973 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.829102 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 01:56:16.829307 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.829436 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.829640 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.829767 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.830007 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.830202 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.830376 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.830530 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.830659 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.830868 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.830998 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.831206 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.831337 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.831528 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.831656 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.831846 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.831987 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.832162 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.832293 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.832510 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.832666 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.832827 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.832956 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.833140 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.833276 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.833455 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.833584 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.833774 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.833910 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.834093 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.834230 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.834409 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.834537 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.834728 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.834858 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.835046 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.835186 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.835358 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.835496 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.835671 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.835799 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.835991 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.836121 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.836311 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.836464 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.836649 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.836791 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.836965 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.837100 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.837308 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.837437 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.837636 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.837773 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.837955 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.838084 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.838276 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.838412 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.838589 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.838737 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.838900 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.839028 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.839212 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.839340 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.839523 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.839659 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.839847 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.839977 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.840163 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.840290 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.840502 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.840632 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.840823 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.840953 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.841137 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.841274 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.841448 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.841583 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.841759 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.841889 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.842070 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.842197 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.842380 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.842508 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.842707 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.842836 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.843020 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.843146 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.843332 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.843469 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.843651 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.843776 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.843946 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.844085 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.844259 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.844387 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.844593 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.844733 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.844901 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.845039 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.845206 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.845836 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.846042 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.846179 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.846357 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.846495 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.846664 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.846801 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.846988 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.847117 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.847315 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.847455 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.847624 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.847754 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.847940 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.848067 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.848262 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.848493 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.848623 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.848747 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.848900 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.849060 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.849195 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.849319 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.849508 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.849634 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.849814 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.849941 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.850127 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.850256 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.850436 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.850564 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.850743 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.850876 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.851063 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.851191 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.851371 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.851507 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.851679 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.851806 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.851990 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.852118 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.852298 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.852447 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.852635 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.852775 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.852951 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.853111 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.853264 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.853393 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.853577 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.853720 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.853891 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.854029 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.854204 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.854334 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.854528 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.854667 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.854849 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.854986 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.855164 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.855295 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.855502 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.855634 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.855818 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.855939 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.856131 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.856258 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.856480 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.856616 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.856804 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.856931 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.857114 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.857245 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.857421 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.857551 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.857728 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.857857 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.858037 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.858173 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.858342 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.858471 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.858653 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.858790 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.858960 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.859099 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.859265 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.859394 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.859570 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.859699 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.859874 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.860015 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.860179 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.860307 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.860509 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.860649 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.860822 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.861036 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.861719 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.861849 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.861973 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.862097 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.862281 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.862420 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.862626 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.862766 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.862937 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.863066 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.863279 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.863419 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.863617 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.863747 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.863938 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.864069 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.864259 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.864388 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.864596 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.864716 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.864915 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.865054 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.865226 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.865355 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.865535 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.865667 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.865847 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.865986 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.866158 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.866287 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.866471 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.866600 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.866781 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.866908 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.867091 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.867219 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.867400 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.867519 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.867708 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.867845 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.868026 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.868164 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.868336 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.868500 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.868675 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.868818 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.868981 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.869119 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.869295 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.869432 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.869634 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.869780 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.869951 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.870087 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.870269 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.870397 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.870580 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.870715 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.870890 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.871018 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.871198 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.871334 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.871506 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.871643 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.871815 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.871942 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.872124 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.872254 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.872467 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.872612 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.872782 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.872920 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.873101 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.873231 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.873412 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.873543 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.873729 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.873856 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.874037 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.874176 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.874348 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.874476 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.874652 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.874779 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.874959 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.875087 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.875273 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.875412 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.875602 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.875740 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.875913 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.876050 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.876227 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.876358 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.876577 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.876719 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.876918 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.877063 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.877313 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.877445 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.877635 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.877764 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.877952 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.878159 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.878286 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.878408 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.878556 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.878695 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.878868 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.879011 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.879178 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.879306 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.879488 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.879616 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.879793 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.879922 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.880098 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.880225 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.880449 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.880582 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.880725 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.880852 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.881023 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.881154 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.881326 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.881461 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.881637 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.881769 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.881950 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.882077 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.882260 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.882395 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.882582 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.882713 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.882890 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.883020 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.883195 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.883329 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.883503 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.883635 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.883817 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.883945 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.884123 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.884262 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.884446 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.884580 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.884754 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.884896 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.885058 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.885196 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.885393 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.885522 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.885699 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.885830 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.886004 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.886153 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.886322 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.886460 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.886632 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.886767 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.886941 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.887078 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.887249 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.887378 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.887556 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.887688 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.887866 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.888008 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.888183 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.888311 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.888517 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.888648 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.888826 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.888956 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.889134 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.889261 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.889442 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.889570 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.889751 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.889880 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.890058 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.890186 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.890373 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.890500 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.890680 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.890809 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.890989 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.891119 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.891297 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.891440 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.891601 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.891728 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.891912 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.892033 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.892286 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.892715 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.892856 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.893056 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.893186 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.893376 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.893506 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.893700 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.893831 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.894023 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.894153 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.894346 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.894490 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.894680 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.894810 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.895010 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.895147 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.895350 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.895493 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.895656 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.895803 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.895969 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.896108 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.896277 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.896458 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.896598 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.896730 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.896908 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.897039 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.897215 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.897343 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.897520 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.897649 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.897825 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.897955 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.898134 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.898264 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.898438 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.898577 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.898745 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.898875 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.899049 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.899177 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.899354 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.899493 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.899666 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.899796 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.899972 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.900107 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.900282 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.900453 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.900609 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.900737 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.900932 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.901060 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.901242 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.901388 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.901545 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.901675 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.901850 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.901980 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.902183 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.902310 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.902482 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.902615 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.902787 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.902922 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.903128 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.903260 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.903460 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.903596 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.903803 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.903932 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.904111 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.904240 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.904438 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.904571 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.904758 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.904901 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.905063 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.905193 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.905371 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.905508 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.905676 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.905821 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.905986 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.906124 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.906295 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.906425 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.906599 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.906737 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.906909 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.907038 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.907218 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.907345 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.907526 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.907662 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.908714 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.908846 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.908846 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.909061 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.909178 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.909286 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.909390 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.909520 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.909637 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.909843 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.909967 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.910158 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.910275 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.910466 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.910580 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.910773 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.910900 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.911082 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.911202 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.911390 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.911513 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.911694 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.911819 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.912261 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.912384 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.912595 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.912709 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.912902 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.913017 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.913206 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.913333 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.913511 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.913625 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.913814 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.913928 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.914217 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.914334 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.914441 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.914555 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.914715 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.914828 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.915025 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.915145 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.915334 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.915463 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.915639 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.915752 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.915943 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.916058 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.916246 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.916377 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.916574 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.916700 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.916881 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.916997 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.917192 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.917339 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.917509 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.917622 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.917815 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.917929 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.918119 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.918258 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.918429 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.918517 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.918734 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.918823 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.919040 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.919129 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.919343 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.919430 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.919646 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.919733 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.919948 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.920037 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.920250 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.920338 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.920577 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.920676 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.920882 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.920970 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.921186 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.921272 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.921504 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.921600 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.921810 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.921906 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.922113 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.922201 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.922416 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.922513 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.922717 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.922804 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.923053 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.923139 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.923358 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.923510 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.924285 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.924385 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.924626 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.924727 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.924940 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.925038 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.925260 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.925355 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.925573 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.925667 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.925887 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.925976 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.926194 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.926284 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.926499 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.926600 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.926811 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.926906 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.927119 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.927206 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.927423 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.927519 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.927729 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.927825 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.928057 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.928159 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.928356 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.928487 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.928690 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.928781 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.929006 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.929093 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.929328 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.929424 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.929648 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.929735 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.929975 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.930070 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.930281 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.930385 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.930573 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.930661 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.930880 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.930975 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.931188 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.931285 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.931495 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.931589 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.931802 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.931897 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.932113 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.932285 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.932442 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.932533 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.932754 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.932852 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.933064 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.933160 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.933369 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.933457 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.933675 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.933762 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.933984 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.934073 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.934292 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.934380 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.934596 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.934682 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.934919 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.935007 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.935227 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.935315 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.935530 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.935626 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.935837 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.935924 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.936143 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.936230 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.936474 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.936629 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.936784 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.936914 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.937217 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.937350 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.937530 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.937669 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.937840 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.937979 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.938181 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.938325 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.938458 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.938593 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.938753 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.938892 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.939092 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.939231 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.939532 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.939669 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.939801 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.940050 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.940181 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.940368 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.940529 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.940705 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.940834 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.941022 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.941159 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.941329 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.941472 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.941635 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.941763 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.941945 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.942086 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.942272 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.942410 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.942575 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.942710 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.942879 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.943006 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.943184 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.943312 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.943505 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.943633 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.943809 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.943936 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.944128 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.944256 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.944569 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.944703 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.944884 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.945010 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.945190 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.945318 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.945607 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.945736 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.945918 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.946053 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.946228 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.946364 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.946550 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.946686 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.946872 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.947010 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.947195 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.947323 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.947500 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.947655 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.947817 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.947945 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.948165 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.948326 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.948511 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.948641 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.948768 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.948892 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.949087 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.949225 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.949402 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.949530 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.949708 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.949839 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.950033 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.950172 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.950357 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.950494 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.950672 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.950802 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.950995 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.951135 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.951410 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.951540 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.951735 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.951871 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.952047 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.952185 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.952369 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.952532 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.952717 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.952846 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.953025 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.953168 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.953343 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.953479 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.953613 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.953740 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.953924 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.954066 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.954228 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.954358 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.954554 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.954705 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.954901 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.955171 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.955302 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.955493 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.955680 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.955820 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.955993 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.956126 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.956302 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.956470 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.956635 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.956783 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.956962 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.957093 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.957269 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.957400 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.957596 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.957740 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.957913 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.958044 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.958272 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.958403 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.958561 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.958702 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.958871 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.959003 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.959196 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.959326 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.959507 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.959637 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.959814 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.959943 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.960118 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.960246 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.960443 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.960577 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.960790 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.960932 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.961096 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.961234 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.961417 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.961554 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.961746 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.961875 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.962075 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.962205 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.962385 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.962516 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.962718 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.962855 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.963046 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.963183 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.963366 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.963496 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.963682 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.963811 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.964006 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.964143 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.964311 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.964453 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.964638 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.964778 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.964949 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.965090 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.965255 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.965392 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.965559 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.965688 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.965862 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.966001 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.966171 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.966300 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.966476 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.966614 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.966779 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.966908 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.967081 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.967209 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.967404 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.967533 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.967711 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.967841 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.968032 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.968168 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.968379 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.968565 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.968711 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.968838 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.968963 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.969087 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.969260 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.969390 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.969604 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.969736 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.969910 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.970039 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.970243 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.970880 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.971075 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.971223 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.971487 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.971626 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.971822 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.971963 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.972137 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.972269 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.972488 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.972632 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.972810 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.972990 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.973119 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.973243 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.973431 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.973563 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.973747 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.973886 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.974062 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.974199 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.974377 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.974508 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.974692 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.974815 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.975001 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.975131 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.975314 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.975450 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.975627 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.975757 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.975944 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.976082 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.976498 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.976631 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.976833 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.976971 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.977150 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.977279 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.977465 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.977602 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.977779 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.977909 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.978093 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.978223 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.978408 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.978624 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.978754 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.978877 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.979023 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.979154 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.979336 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.979474 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.979646 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.979775 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.979973 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.980100 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.980294 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.980520 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.980650 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.980776 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.980971 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.981101 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.981289 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.981419 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.981604 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.981739 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.981918 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.982046 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.982233 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.982363 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.982586 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.982717 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.982899 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.983039 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.983207 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.983335 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.983521 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.983648 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.983837 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.983979 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.984151 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.984279 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.984485 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.984615 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.984800 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.984934 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.985115 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.985243 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.985429 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.985556 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.985740 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.985877 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.986602 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.986734 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.986922 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.987053 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.987239 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.987371 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.987566 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.987697 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.987902 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.988106 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.988236 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.988360 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.988551 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.988696 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.988867 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.989005 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.989187 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.989331 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.989705 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.989826 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.990024 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.990165 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.990358 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.990486 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.990687 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.990817 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.991013 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.991151 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.991333 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.991463 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.991651 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.991780 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.991976 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.992105 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.992285 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.992467 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.992617 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.992759 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.992930 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.993059 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.993240 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.993368 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.993548 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.993676 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.993871 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.994001 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.994183 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.994311 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.994491 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.994619 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.994811 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.994942 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.995123 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.995251 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.995652 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.995790 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.996002 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.996130 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.996319 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.996469 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.996678 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.996820 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.997007 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.997144 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.997326 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.997455 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.997634 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.997772 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.997960 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.998089 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.998268 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.998404 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.998575 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.998711 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.998893 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.999023 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.999207 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.999337 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.999516 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.999647 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.999822 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:16.999951 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.000134 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.000262 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.000465 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.000597 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.000776 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.000905 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.001089 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.001220 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.001397 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.001535 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.001750 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.001879 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.002062 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.002192 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.002371 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.002503 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.002680 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.002811 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.002995 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.003134 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.003304 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.003447 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.003608 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.003738 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.003915 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.004051 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.004220 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.004350 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.004557 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.004696 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.004862 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.005003 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.005174 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.005302 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.005479 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.005608 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.005793 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.005935 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.006096 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.006224 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.006407 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.006535 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.006758 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.006887 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.007083 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.007211 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.007390 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.007520 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.007696 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.007826 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.008012 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.008140 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.008322 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.008475 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.008672 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.008831 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.008985 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.009113 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.009296 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.009424 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.009644 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.009783 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.009963 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.010093 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.010492 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.010633 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.010825 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.010953 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.011146 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.011276 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.011479 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.011617 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.011809 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.011946 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.012122 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.012252 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.012448 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.012597 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.012758 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.012886 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.013085 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.013221 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.013395 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.013534 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.013708 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.013845 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.014020 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.014149 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.014332 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.014462 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.014642 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.014772 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.014953 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.015085 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.015261 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.015397 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.015572 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.015702 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.015881 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.016010 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.016192 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.016321 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.016526 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.016657 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.016838 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.016978 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.017149 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.017317 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.017487 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.017687 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.017818 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.018122 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.018256 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.018438 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.018566 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.018755 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.018885 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.019072 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.019202 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.019382 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.019518 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.019690 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.019832 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.019998 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.020127 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.020324 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.020475 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.020640 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.020782 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.020961 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.021099 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.021273 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.021401 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.021581 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.021720 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.021892 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.022020 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.022300 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.022436 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.022616 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.022744 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.022936 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.023063 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.023248 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.023377 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.023559 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.023688 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.023883 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.024011 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.024197 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.024342 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.024525 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.024652 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.024844 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.024972 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.025154 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.025291 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.025489 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.025620 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.025820 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.025947 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.026147 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.026285 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.026455 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.026585 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.026761 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.026890 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.027068 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.027206 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.027375 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.027504 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.027689 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.027818 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.027999 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.028137 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.028308 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.028460 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.028639 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.028779 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.028950 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.029079 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.029257 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.029388 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.029562 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.029697 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.029866 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.030004 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.030170 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.030295 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.030462 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.030595 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.030766 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.030895 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.031068 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.031205 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.031370 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.031499 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.031673 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.031810 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.031974 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.032111 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.032277 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.032446 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.032604 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.032746 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.033428 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.033600 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.033736 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.033916 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.034062 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.034197 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.034323 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.034461 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.034595 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.034732 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.034930 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.035068 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.035262 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.035401 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.035580 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.035720 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.035903 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.036041 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.036217 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.036347 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.036565 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.036698 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.036876 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.037274 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.037470 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.037599 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.037792 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.037923 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.038106 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.038235 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.038419 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.038555 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.038731 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.038872 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.039048 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.039177 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.039363 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.039502 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.039676 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.039812 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.039992 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.040130 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.040302 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.040500 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.040630 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.040754 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.040936 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.041069 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.041264 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.041402 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.041573 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.041704 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.041885 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.042021 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.042210 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.042348 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.042530 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.042658 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.042849 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.042991 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.043163 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.043294 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.043475 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.043603 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.043793 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.043922 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.044106 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.044245 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.044431 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.044563 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.044746 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.044875 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.045057 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.045199 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.045372 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.045504 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.045688 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.045826 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.046006 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.046134 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.046332 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.046461 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.046645 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.046782 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.046960 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.047088 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.047288 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.047417 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.047616 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.047822 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.047951 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.048075 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.048268 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.048415 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.048676 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.048876 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.049026 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.049154 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.049296 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.049421 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.049605 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.049743 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.049877 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 08 01:56:17.050032 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 01:56:17.050281 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 08 01:56:17.108307 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO dbcounter [None req-cd7ec4a1-5b94-4996-8d44-a98e1da63657 None None] Registered counter for database nova_api Jun 08 01:56:17.108519 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO dbcounter [None req-836565cc-8c86-434d-9fd9-48d9b579f6ed None None] Registered counter for database nova_api Jun 08 01:56:17.128088 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG oslo_db.sqlalchemy.engines [None req-836565cc-8c86-434d-9fd9-48d9b579f6ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103494) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 01:56:17.130181 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG oslo_db.sqlalchemy.engines [None req-cd7ec4a1-5b94-4996-8d44-a98e1da63657 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103495) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 01:56:17.134670 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG dbcounter [-] [103494] Writer thread running {{(pid=103494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 01:56:17.136635 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG dbcounter [-] [103495] Writer thread running {{(pid=103495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 01:56:17.191835 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.context [None req-836565cc-8c86-434d-9fd9-48d9b579f6ed None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),876846fb-da6a-4e76-ba4b-88f12695565c(cell1) {{(pid=103494) load_cells /opt/stack/nova/nova/context.py:464}} Jun 08 01:56:17.194966 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.context [None req-cd7ec4a1-5b94-4996-8d44-a98e1da63657 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),876846fb-da6a-4e76-ba4b-88f12695565c(cell1) {{(pid=103495) load_cells /opt/stack/nova/nova/context.py:464}} Jun 08 01:56:17.195959 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG oslo_concurrency.lockutils [None req-836565cc-8c86-434d-9fd9-48d9b579f6ed None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 01:56:17.197598 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG oslo_concurrency.lockutils [None req-836565cc-8c86-434d-9fd9-48d9b579f6ed None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 01:56:17.198386 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG oslo_concurrency.lockutils [None req-836565cc-8c86-434d-9fd9-48d9b579f6ed None None] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 01:56:17.199033 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG oslo_concurrency.lockutils [None req-cd7ec4a1-5b94-4996-8d44-a98e1da63657 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 01:56:17.200347 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG oslo_concurrency.lockutils [None req-836565cc-8c86-434d-9fd9-48d9b579f6ed None None] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 01:56:17.200630 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG oslo_concurrency.lockutils [None req-cd7ec4a1-5b94-4996-8d44-a98e1da63657 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 01:56:17.201418 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG oslo_concurrency.lockutils [None req-cd7ec4a1-5b94-4996-8d44-a98e1da63657 None None] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 01:56:17.202373 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO dbcounter [None req-836565cc-8c86-434d-9fd9-48d9b579f6ed None None] Registered counter for database nova_cell0 Jun 08 01:56:17.203349 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG oslo_concurrency.lockutils [None req-cd7ec4a1-5b94-4996-8d44-a98e1da63657 None None] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 01:56:17.206231 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO dbcounter [None req-cd7ec4a1-5b94-4996-8d44-a98e1da63657 None None] Registered counter for database nova_cell0 Jun 08 01:56:17.206985 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO dbcounter [None req-836565cc-8c86-434d-9fd9-48d9b579f6ed None None] Registered counter for database nova_cell1 Jun 08 01:56:17.210193 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO dbcounter [None req-cd7ec4a1-5b94-4996-8d44-a98e1da63657 None None] Registered counter for database nova_cell1 Jun 08 01:56:17.216565 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG oslo_db.sqlalchemy.engines [None req-836565cc-8c86-434d-9fd9-48d9b579f6ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103494) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 01:56:17.217335 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG oslo_db.sqlalchemy.engines [None req-836565cc-8c86-434d-9fd9-48d9b579f6ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103494) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 01:56:17.218223 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG oslo_db.sqlalchemy.engines [None req-cd7ec4a1-5b94-4996-8d44-a98e1da63657 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103495) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 01:56:17.222518 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG oslo_db.sqlalchemy.engines [None req-cd7ec4a1-5b94-4996-8d44-a98e1da63657 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103495) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 01:56:17.225120 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG dbcounter [-] [103495] Writer thread running {{(pid=103495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 01:56:17.225232 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG dbcounter [-] [103494] Writer thread running {{(pid=103494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 01:56:17.226463 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG dbcounter [-] [103494] Writer thread running {{(pid=103494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 01:56:17.366488 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG dbcounter [-] [103495] Writer thread running {{(pid=103495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 01:56:17.372222 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO dbcounter [None req-836565cc-8c86-434d-9fd9-48d9b579f6ed None None] Registered counter for database nova_cell0 Jun 08 01:56:17.375111 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO dbcounter [None req-cd7ec4a1-5b94-4996-8d44-a98e1da63657 None None] Registered counter for database nova_cell0 Jun 08 01:56:17.381596 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG oslo_db.sqlalchemy.engines [None req-836565cc-8c86-434d-9fd9-48d9b579f6ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103494) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 01:56:17.383040 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG oslo_db.sqlalchemy.engines [None req-cd7ec4a1-5b94-4996-8d44-a98e1da63657 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103495) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 01:56:17.386100 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG dbcounter [-] [103494] Writer thread running {{(pid=103494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 01:56:17.387401 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG dbcounter [-] [103495] Writer thread running {{(pid=103495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 01:56:17.851284 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: WARNING keystonemiddleware.auth_token [None req-cd7ec4a1-5b94-4996-8d44-a98e1da63657 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 08 01:56:17.858627 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: WARNING keystonemiddleware.auth_token [None req-cd7ec4a1-5b94-4996-8d44-a98e1da63657 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 08 01:56:17.859056 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: WARNING keystonemiddleware.auth_token [None req-836565cc-8c86-434d-9fd9-48d9b579f6ed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 08 01:56:17.867201 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: WARNING keystonemiddleware.auth_token [None req-836565cc-8c86-434d-9fd9-48d9b579f6ed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 08 01:56:18.085290 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: WARNING keystonemiddleware.auth_token [None req-cd7ec4a1-5b94-4996-8d44-a98e1da63657 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 08 01:56:18.091335 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: WARNING keystonemiddleware.auth_token [None req-cd7ec4a1-5b94-4996-8d44-a98e1da63657 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 08 01:56:18.098104 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56066fae69c0 pid: 103495 (default app) Jun 08 01:56:18.098592 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: WARNING keystonemiddleware.auth_token [None req-836565cc-8c86-434d-9fd9-48d9b579f6ed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 08 01:56:18.100152 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-cd7ec4a1-5b94-4996-8d44-a98e1da63657 None None] Calling method '>' {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:56:18.101423 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-cd7ec4a1-5b94-4996-8d44-a98e1da63657 None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001750 Jun 08 01:56:18.101790 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Wed Jun 8 01:56:18 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 01:56:18.104624 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: WARNING keystonemiddleware.auth_token [None req-836565cc-8c86-434d-9fd9-48d9b579f6ed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 08 01:56:18.109770 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56066fae69c0 pid: 103494 (default app) Jun 08 01:57:37.347286 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-cd7ec4a1-5b94-4996-8d44-a98e1da63657 None None] Calling method '>' {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:57:37.348940 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-cd7ec4a1-5b94-4996-8d44-a98e1da63657 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002082 Jun 08 01:57:37.350689 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jun 8 01:57:37 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 01:57:37.364939 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG dbcounter [-] [103494] Writing DB stats nova_api:SELECT=3 {{(pid=103494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 01:57:37.366771 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG dbcounter [-] [103494] Writing DB stats nova_cell0:SELECT=3 {{(pid=103494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 01:57:37.367883 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG dbcounter [-] [103494] Writing DB stats nova_cell1:SELECT=3 {{(pid=103494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 01:57:37.368994 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG dbcounter [-] [103494] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 01:57:37.817528 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-aff6bf3b-979c-4d2e-bad9-51ac8220ef38 admin admin] Calling method '>' {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:57:37.849425 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.requestlog [None req-aff6bf3b-979c-4d2e-bad9-51ac8220ef38 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.490474 Jun 08 01:57:37.850244 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: [pid: 103494|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1291 bytes} [Wed Jun 8 01:57:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 01:57:40.334348 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-cd7ec4a1-5b94-4996-8d44-a98e1da63657 None None] Calling method '>' {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:57:40.335353 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-cd7ec4a1-5b94-4996-8d44-a98e1da63657 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jun 08 01:57:40.335753 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 3/4] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jun 8 01:57:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 01:57:40.399362 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-3df8c1a9-bf23-44e4-953a-266935ffb280 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "id": "c1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "cirros256", "os-flavor-access:is_public": true, "ram": 256, "swap": 0}} {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 01:57:40.418167 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 08 01:57:40.418167 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: warnings.warn(msg) Jun 08 01:57:40.446572 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.requestlog [None req-3df8c1a9-bf23-44e4-953a-266935ffb280 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.104812 Jun 08 01:57:40.447313 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: [pid: 103494|app: 0|req: 2/5] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Jun 8 01:57:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 08 01:57:40.664765 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-14ddacac-b150-43cb-bb3d-74efa4102b5a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 01:57:40.667198 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 08 01:57:40.667198 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: warnings.warn(msg) Jun 08 01:57:40.670058 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG dbcounter [-] [103495] Writing DB stats nova_api:SELECT=3 {{(pid=103495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 01:57:40.670786 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG dbcounter [-] [103495] Writing DB stats nova_cell0:SELECT=3 {{(pid=103495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 01:57:40.671846 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG dbcounter [-] [103495] Writing DB stats nova_cell1:SELECT=3 {{(pid=103495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 01:57:40.672967 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG dbcounter [-] [103495] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 01:57:40.736010 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-14ddacac-b150-43cb-bb3d-74efa4102b5a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.280132 Jun 08 01:57:40.736630 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 4/6] 10.222.0.20 () {64 vars in 1335 bytes} [Wed Jun 8 01:57:40 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 01:57:43.050958 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-3df8c1a9-bf23-44e4-953a-266935ffb280 admin admin] Calling method '>' {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:57:43.051972 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.requestlog [None req-3df8c1a9-bf23-44e4-953a-266935ffb280 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jun 08 01:57:43.052373 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: [pid: 103494|app: 0|req: 3/7] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jun 8 01:57:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 01:57:43.157173 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-552759ee-ebfc-4502-baa6-7eb37c22ea97 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "vcpus": 1, "id": "d1", "name": "ds512M", "swap": 0}} {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 01:57:43.175396 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 08 01:57:43.175396 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: warnings.warn(msg) Jun 08 01:57:43.193861 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-552759ee-ebfc-4502-baa6-7eb37c22ea97 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.135225 Jun 08 01:57:43.194839 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 5/8] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Jun 8 01:57:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 08 01:57:43.206973 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-20213d19-f835-4687-9d82-d07d75e8dbca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 01:57:43.208557 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 08 01:57:43.208557 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: warnings.warn(msg) Jun 08 01:57:43.240463 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.requestlog [None req-20213d19-f835-4687-9d82-d07d75e8dbca admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037457 Jun 08 01:57:43.241364 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: [pid: 103494|app: 0|req: 4/9] 10.222.0.20 () {64 vars in 1335 bytes} [Wed Jun 8 01:57:43 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 01:57:45.589081 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-552759ee-ebfc-4502-baa6-7eb37c22ea97 admin admin] Calling method '>' {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:57:45.590128 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-552759ee-ebfc-4502-baa6-7eb37c22ea97 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Jun 08 01:57:45.590815 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jun 8 01:57:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 01:57:45.655741 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-4bdc584b-f2ae-4ff2-8822-4c2163a3b389 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "disk": 10, "vcpus": 1}} {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 01:57:45.678733 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.requestlog [None req-4bdc584b-f2ae-4ff2-8822-4c2163a3b389 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081167 Jun 08 01:57:45.679376 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: [pid: 103494|app: 0|req: 5/11] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Jun 8 01:57:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 08 01:57:45.696299 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-51fea0c8-490d-4084-af20-ff984dd4d38a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 01:57:45.729116 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-51fea0c8-490d-4084-af20-ff984dd4d38a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040809 Jun 08 01:57:45.729866 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 7/12] 10.222.0.20 () {64 vars in 1335 bytes} [Wed Jun 8 01:57:45 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 01:57:48.042077 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-4bdc584b-f2ae-4ff2-8822-4c2163a3b389 admin admin] Calling method '>' {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:57:48.043106 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.requestlog [None req-4bdc584b-f2ae-4ff2-8822-4c2163a3b389 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Jun 08 01:57:48.043562 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: [pid: 103494|app: 0|req: 6/13] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jun 8 01:57:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 01:57:48.108660 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-1694eda7-bcc7-4c9c-b554-6904048758f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "ram": 2048, "swap": 0, "vcpus": 2, "id": "d3", "name": "ds2G"}} {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 01:57:48.127594 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-1694eda7-bcc7-4c9c-b554-6904048758f2 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077767 Jun 08 01:57:48.128176 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 8/14] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Jun 8 01:57:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 08 01:57:48.140879 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-ba82186e-9eac-4e78-bc9e-0b5fd3b6750d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 01:57:48.165763 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.requestlog [None req-ba82186e-9eac-4e78-bc9e-0b5fd3b6750d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029074 Jun 08 01:57:48.166274 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: [pid: 103494|app: 0|req: 7/15] 10.222.0.20 () {64 vars in 1335 bytes} [Wed Jun 8 01:57:48 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 01:57:50.494177 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-1694eda7-bcc7-4c9c-b554-6904048758f2 admin admin] Calling method '>' {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:57:50.495187 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-1694eda7-bcc7-4c9c-b554-6904048758f2 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jun 08 01:57:50.495594 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 9/16] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jun 8 01:57:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 01:57:50.557125 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-ac37e03b-15ef-4771-8920-0ff4f48840da admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "rxtx_factor": 1.0, "vcpus": 4, "disk": 20, "id": "d4"}} {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 01:57:50.578897 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.requestlog [None req-ac37e03b-15ef-4771-8920-0ff4f48840da admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076620 Jun 08 01:57:50.579773 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: [pid: 103494|app: 0|req: 8/17] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Jun 8 01:57:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 08 01:57:50.591821 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-609c1bec-50f7-4121-92ca-1d4c6764cd77 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 01:57:50.616723 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-609c1bec-50f7-4121-92ca-1d4c6764cd77 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028689 Jun 08 01:57:50.621147 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 10/18] 10.222.0.20 () {64 vars in 1335 bytes} [Wed Jun 8 01:57:50 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 01:57:52.955898 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-ac37e03b-15ef-4771-8920-0ff4f48840da admin admin] Calling method '>' {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:57:52.956957 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.requestlog [None req-ac37e03b-15ef-4771-8920-0ff4f48840da admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jun 08 01:57:52.957366 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: [pid: 103494|app: 0|req: 9/19] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jun 8 01:57:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 01:57:53.018547 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-a4f5840c-ef3d-46ec-a198-fac0dcf16e5e admin admin] Calling method '>' {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:57:53.042334 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-a4f5840c-ef3d-46ec-a198-fac0dcf16e5e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.078741 Jun 08 01:57:53.043211 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1291 bytes} [Wed Jun 8 01:57:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 01:57:55.343761 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-ac37e03b-15ef-4771-8920-0ff4f48840da admin admin] Calling method '>' {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:57:55.345355 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.requestlog [None req-ac37e03b-15ef-4771-8920-0ff4f48840da admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002402 Jun 08 01:57:55.345958 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: [pid: 103494|app: 0|req: 10/21] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jun 8 01:57:55 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 01:57:55.419259 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-bbde6a67-814d-4cb2-89e4-9c677b6370ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "disk": 1, "id": "1", "vcpus": 1, "ram": 512}} {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 01:57:55.437799 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-bbde6a67-814d-4cb2-89e4-9c677b6370ba admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.086107 Jun 08 01:57:55.438355 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 12/22] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Jun 8 01:57:55 2022] POST /compute/v2.1/flavors => generated 402 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 08 01:57:55.455015 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-05a021a9-908b-4748-97c0-5794e0076dc5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 01:57:55.484942 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.requestlog [None req-05a021a9-908b-4748-97c0-5794e0076dc5 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035673 Jun 08 01:57:55.485720 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: [pid: 103494|app: 0|req: 11/23] 10.222.0.20 () {64 vars in 1332 bytes} [Wed Jun 8 01:57:55 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 01:57:58.581154 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-bbde6a67-814d-4cb2-89e4-9c677b6370ba admin admin] Calling method '>' {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:57:58.582195 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-bbde6a67-814d-4cb2-89e4-9c677b6370ba admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Jun 08 01:57:58.582599 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jun 8 01:57:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 01:57:58.643631 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-91749ea8-a7e2-4479-b402-67370182bb63 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "ram": 2048, "disk": 20, "os-flavor-access:is_public": true, "vcpus": 1, "id": "2", "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 01:57:58.661206 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.requestlog [None req-91749ea8-a7e2-4479-b402-67370182bb63 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072592 Jun 08 01:57:58.661769 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: [pid: 103494|app: 0|req: 12/25] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Jun 8 01:57:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 08 01:57:58.676597 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-1297e0cc-b1c9-4add-aa1b-d20a34afdfc7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 01:57:58.700280 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-1297e0cc-b1c9-4add-aa1b-d20a34afdfc7 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027381 Jun 08 01:57:58.701104 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 14/26] 10.222.0.20 () {64 vars in 1332 bytes} [Wed Jun 8 01:57:58 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 01:58:01.165392 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-91749ea8-a7e2-4479-b402-67370182bb63 admin admin] Calling method '>' {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:58:01.166344 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.requestlog [None req-91749ea8-a7e2-4479-b402-67370182bb63 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jun 08 01:58:01.166747 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: [pid: 103494|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jun 8 01:58:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 01:58:01.231380 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-e6a70e31-1fb0-448c-bea6-212455bb674d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "os-flavor-access:is_public": true, "name": "m1.medium", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2, "ram": 4096, "disk": 40}} {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 01:58:01.249876 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-e6a70e31-1fb0-448c-bea6-212455bb674d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.076431 Jun 08 01:58:01.250428 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 15/28] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Jun 8 01:58:01 2022] POST /compute/v2.1/flavors => generated 406 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 08 01:58:01.262566 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-f29b4e26-d5fd-4eed-a748-f6696af3bf6a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 01:58:01.285256 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.requestlog [None req-f29b4e26-d5fd-4eed-a748-f6696af3bf6a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026423 Jun 08 01:58:01.285831 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: [pid: 103494|app: 0|req: 14/29] 10.222.0.20 () {64 vars in 1332 bytes} [Wed Jun 8 01:58:01 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 01:58:03.617889 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-e6a70e31-1fb0-448c-bea6-212455bb674d admin admin] Calling method '>' {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:58:03.619484 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-e6a70e31-1fb0-448c-bea6-212455bb674d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002030 Jun 08 01:58:03.620301 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 16/30] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jun 8 01:58:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 01:58:03.684420 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-034414c8-a600-4a9a-b8dc-443e09a297d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "swap": 0, "ram": 8192, "vcpus": 4, "name": "m1.large"}} {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 01:58:03.704631 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.requestlog [None req-034414c8-a600-4a9a-b8dc-443e09a297d0 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078592 Jun 08 01:58:03.705175 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: [pid: 103494|app: 0|req: 15/31] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Jun 8 01:58:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 08 01:58:03.716987 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-fe2a5a8c-8c4c-468a-9f06-331d0de10d5a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 01:58:03.741344 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-fe2a5a8c-8c4c-468a-9f06-331d0de10d5a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027921 Jun 08 01:58:03.742255 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 17/32] 10.222.0.20 () {64 vars in 1332 bytes} [Wed Jun 8 01:58:03 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 01:58:06.106644 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-034414c8-a600-4a9a-b8dc-443e09a297d0 admin admin] Calling method '>' {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:58:06.107674 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.requestlog [None req-034414c8-a600-4a9a-b8dc-443e09a297d0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jun 08 01:58:06.108081 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: [pid: 103494|app: 0|req: 16/33] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jun 8 01:58:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 01:58:06.169004 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-f3982318-69fe-46c3-96c8-664261ba3ec8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 16384, "name": "m1.xlarge", "id": "5"}} {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 01:58:06.189860 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-f3982318-69fe-46c3-96c8-664261ba3ec8 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.075558 Jun 08 01:58:06.190813 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 18/34] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Jun 8 01:58:06 2022] POST /compute/v2.1/flavors => generated 408 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 08 01:58:06.202472 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-b39c719f-49b0-42f1-86ba-73194d6d1a8d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 01:58:06.225666 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.requestlog [None req-b39c719f-49b0-42f1-86ba-73194d6d1a8d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026898 Jun 08 01:58:06.226245 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: [pid: 103494|app: 0|req: 17/35] 10.222.0.20 () {64 vars in 1332 bytes} [Wed Jun 8 01:58:06 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 01:58:29.696670 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-f3982318-69fe-46c3-96c8-664261ba3ec8 admin admin] Calling method '>' {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:58:29.697671 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-f3982318-69fe-46c3-96c8-664261ba3ec8 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jun 08 01:58:29.698077 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jun 8 01:58:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 01:58:29.709293 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG dbcounter [-] [103494] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 01:58:29.757763 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-c1111ae8-2917-4c00-89fc-833650c8f636 admin admin] Calling method '>' {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:58:29.775580 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.requestlog [None req-c1111ae8-2917-4c00-89fc-833650c8f636 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070877 Jun 08 01:58:29.776113 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: [pid: 103494|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1291 bytes} [Wed Jun 8 01:58:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 01:58:30.796480 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-f3982318-69fe-46c3-96c8-664261ba3ec8 admin admin] Calling method '>' {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:58:30.797476 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-f3982318-69fe-46c3-96c8-664261ba3ec8 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jun 08 01:58:30.797874 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Jun 8 01:58:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 01:58:31.003266 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-a7f6fd27-5e3a-4396-a147-7c61d9af7159 admin admin] Calling method '>' {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:58:31.008897 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.wsgi [None req-a7f6fd27-5e3a-4396-a147-7c61d9af7159 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 08 01:58:31.011979 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-a7f6fd27-5e3a-4396-a147-7c61d9af7159 admin admin] Request method failure captured: Jun 08 01:58:31.011979 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 08 01:58:31.011979 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: Accept: application/json Jun 08 01:58:31.011979 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: Accept-Encoding: gzip, deflate Jun 08 01:58:31.011979 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: Connection: keep-alive Jun 08 01:58:31.011979 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: Content-Length: 0 Jun 08 01:58:31.011979 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: Host: 10.222.0.20 Jun 08 01:58:31.011979 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: Openstack-Api-Version: compute 2.90 Jun 08 01:58:31.011979 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: Openstack-System-Scope: None Jun 08 01:58:31.011979 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: User-Agent: python-novaclient Jun 08 01:58:31.011979 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Auth-Token: gAAAAABioAJGRDn0g-Hq4N7ixV_qr63hOm-fB5czwzLr2VRwURhEU-orSRjq6UuLcQExDaDPKxtneplCoXLk5YhFn5HGx4EShKlAPwK5A4OYn-3A11_LS3QLx5gX1_6eC6ywqw6uoOAxIRdCMkJzJHaoBXFrcIgFhQ_AZW5CAJGmkHlizCCHz3E Jun 08 01:58:31.011979 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Domain-Id: None Jun 08 01:58:31.011979 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Domain-Name: None Jun 08 01:58:31.011979 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Identity-Status: Confirmed Jun 08 01:58:31.011979 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Is-Admin-Project: True Jun 08 01:58:31.011979 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Openstack-Nova-Api-Version: 2.90 Jun 08 01:58:31.011979 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Project-Domain-Id: default Jun 08 01:58:31.011979 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Project-Domain-Name: Default Jun 08 01:58:31.011979 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Project-Id: d34d18aa450b41d2ac1001da2d9a5476 Jun 08 01:58:31.011979 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Project-Name: admin Jun 08 01:58:31.011979 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Role: reader,admin,member Jun 08 01:58:31.011979 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Roles: reader,admin,member Jun 08 01:58:31.013718 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d34d18aa450b41d2ac1001da2d9a5476"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d34d18aa450b41d2ac1001da2d9a5476", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d34d18aa450b41d2ac1001da2d9a5476"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d34d18aa450b41d2ac1001da2d9a5476"}]}] Jun 08 01:58:31.013718 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Tenant: admin Jun 08 01:58:31.013718 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Tenant-Id: d34d18aa450b41d2ac1001da2d9a5476 Jun 08 01:58:31.013718 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Tenant-Name: admin Jun 08 01:58:31.013718 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-User: admin Jun 08 01:58:31.013718 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-User-Domain-Id: default Jun 08 01:58:31.013718 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-User-Domain-Name: Default Jun 08 01:58:31.013718 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-User-Id: ded448ce0e8547839095b6fee4b26e38 Jun 08 01:58:31.013718 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-User-Name: admin Jun 08 01:58:31.013718 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: method: > Jun 08 01:58:31.013718 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: exception: Flavor 42 could not be found. Jun 08 01:58:31.013718 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: action_args: {'id': '42'} Jun 08 01:58:31.013718 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 01:58:31.013718 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 01:58:31.015698 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 08 01:58:31.015698 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 08 01:58:31.015698 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 08 01:58:31.015698 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 08 01:58:31.015698 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 08 01:58:31.015698 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 08 01:58:31.015698 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 08 01:58:31.015698 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 08 01:58:31.015698 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 08 01:58:31.015698 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 01:58:31.015698 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 08 01:58:31.015698 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 08 01:58:31.015698 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 08 01:58:31.015698 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi Jun 08 01:58:31.015698 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 01:58:31.015698 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi Jun 08 01:58:31.015698 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 01:58:31.015698 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 01:58:31.015698 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 01:58:31.017203 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 01:58:31.017203 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 01:58:31.017203 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 01:58:31.017203 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 01:58:31.017203 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 08 01:58:31.017203 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 08 01:58:31.017203 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 08 01:58:31.017203 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi Jun 08 01:58:31.017203 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 01:58:31.017203 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi Jun 08 01:58:31.017203 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 01:58:31.017203 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 01:58:31.017203 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 01:58:31.017203 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 01:58:31.017203 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 01:58:31.017203 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 08 01:58:31.017203 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi Jun 08 01:58:31.017203 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-a7f6fd27-5e3a-4396-a147-7c61d9af7159 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 01:58:31.018662 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.requestlog [None req-a7f6fd27-5e3a-4396-a147-7c61d9af7159 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060327 Jun 08 01:58:31.018662 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: [pid: 103494|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Jun 8 01:58:30 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 08 01:58:31.023532 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-2e9f9e52-988d-4627-bd9a-86cfbf575fb6 admin admin] Calling method '>' {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:58:31.026450 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG dbcounter [-] [103495] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 01:58:31.046340 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-2e9f9e52-988d-4627-bd9a-86cfbf575fb6 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026296 Jun 08 01:58:31.046985 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Jun 8 01:58:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 01:58:31.060601 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-3827fc2f-1a9b-4d45-ae88-8c7aa790c62c admin admin] Calling method '>' {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:58:31.083511 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.requestlog [None req-3827fc2f-1a9b-4d45-ae88-8c7aa790c62c admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026507 Jun 08 01:58:31.084041 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: [pid: 103494|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Jun 8 01:58:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 01:58:31.093901 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-6dd29cab-e045-4aeb-9814-3292015bd2ae admin admin] Calling method '>' {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:58:31.100276 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.wsgi [None req-6dd29cab-e045-4aeb-9814-3292015bd2ae admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 08 01:58:31.103536 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-6dd29cab-e045-4aeb-9814-3292015bd2ae admin admin] Request method failure captured: Jun 08 01:58:31.103536 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 08 01:58:31.103536 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: Accept: application/json Jun 08 01:58:31.103536 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: Accept-Encoding: gzip, deflate Jun 08 01:58:31.103536 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: Connection: keep-alive Jun 08 01:58:31.103536 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: Content-Length: 0 Jun 08 01:58:31.103536 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: Host: 10.222.0.20 Jun 08 01:58:31.103536 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: Openstack-Api-Version: compute 2.90 Jun 08 01:58:31.103536 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: Openstack-System-Scope: None Jun 08 01:58:31.103536 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: User-Agent: python-novaclient Jun 08 01:58:31.103536 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Auth-Token: gAAAAABioAJGRDn0g-Hq4N7ixV_qr63hOm-fB5czwzLr2VRwURhEU-orSRjq6UuLcQExDaDPKxtneplCoXLk5YhFn5HGx4EShKlAPwK5A4OYn-3A11_LS3QLx5gX1_6eC6ywqw6uoOAxIRdCMkJzJHaoBXFrcIgFhQ_AZW5CAJGmkHlizCCHz3E Jun 08 01:58:31.103536 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Domain-Id: None Jun 08 01:58:31.103536 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Domain-Name: None Jun 08 01:58:31.103536 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Identity-Status: Confirmed Jun 08 01:58:31.103536 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Is-Admin-Project: True Jun 08 01:58:31.103536 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Openstack-Nova-Api-Version: 2.90 Jun 08 01:58:31.103536 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Project-Domain-Id: default Jun 08 01:58:31.103536 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Project-Domain-Name: Default Jun 08 01:58:31.103536 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Project-Id: d34d18aa450b41d2ac1001da2d9a5476 Jun 08 01:58:31.103536 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Project-Name: admin Jun 08 01:58:31.103536 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Role: reader,admin,member Jun 08 01:58:31.103536 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Roles: reader,admin,member Jun 08 01:58:31.104824 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d34d18aa450b41d2ac1001da2d9a5476"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d34d18aa450b41d2ac1001da2d9a5476", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d34d18aa450b41d2ac1001da2d9a5476"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d34d18aa450b41d2ac1001da2d9a5476"}]}] Jun 08 01:58:31.104824 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Tenant: admin Jun 08 01:58:31.104824 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Tenant-Id: d34d18aa450b41d2ac1001da2d9a5476 Jun 08 01:58:31.104824 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Tenant-Name: admin Jun 08 01:58:31.104824 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-User: admin Jun 08 01:58:31.104824 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-User-Domain-Id: default Jun 08 01:58:31.104824 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-User-Domain-Name: Default Jun 08 01:58:31.104824 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-User-Id: ded448ce0e8547839095b6fee4b26e38 Jun 08 01:58:31.104824 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-User-Name: admin Jun 08 01:58:31.104824 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: method: > Jun 08 01:58:31.104824 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: exception: Flavor 42 could not be found. Jun 08 01:58:31.104824 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: action_args: {'id': '42'} Jun 08 01:58:31.104824 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 01:58:31.104824 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 01:58:31.105643 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 08 01:58:31.105643 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 08 01:58:31.105643 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 08 01:58:31.105643 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 08 01:58:31.105643 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 08 01:58:31.105643 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 08 01:58:31.105643 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 08 01:58:31.105643 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 08 01:58:31.105643 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 08 01:58:31.105643 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 01:58:31.105643 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 08 01:58:31.105643 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 08 01:58:31.105643 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 08 01:58:31.105643 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi Jun 08 01:58:31.105643 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 01:58:31.105643 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi Jun 08 01:58:31.105643 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 01:58:31.105643 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 01:58:31.105643 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 01:58:31.106878 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 01:58:31.106878 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 01:58:31.106878 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 01:58:31.106878 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 01:58:31.106878 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 08 01:58:31.106878 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 08 01:58:31.106878 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 08 01:58:31.106878 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi Jun 08 01:58:31.106878 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 01:58:31.106878 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi Jun 08 01:58:31.106878 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 01:58:31.106878 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 01:58:31.106878 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 01:58:31.106878 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 01:58:31.106878 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 01:58:31.106878 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 08 01:58:31.106878 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi Jun 08 01:58:31.106878 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-6dd29cab-e045-4aeb-9814-3292015bd2ae admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 01:58:31.108111 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-6dd29cab-e045-4aeb-9814-3292015bd2ae admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015298 Jun 08 01:58:31.108111 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Jun 8 01:58:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 08 01:58:31.970522 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-3827fc2f-1a9b-4d45-ae88-8c7aa790c62c admin admin] Calling method '>' {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:58:31.971557 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.requestlog [None req-3827fc2f-1a9b-4d45-ae88-8c7aa790c62c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jun 08 01:58:31.971969 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: [pid: 103494|app: 0|req: 21/43] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Jun 8 01:58:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 01:58:32.159169 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-fcb7a398-598e-49e2-9a56-1d39cfa8605e admin admin] Calling method '>' {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:58:32.165304 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.wsgi [None req-fcb7a398-598e-49e2-9a56-1d39cfa8605e admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 08 01:58:32.166791 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-fcb7a398-598e-49e2-9a56-1d39cfa8605e admin admin] Request method failure captured: Jun 08 01:58:32.166791 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 08 01:58:32.166791 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: Accept: application/json Jun 08 01:58:32.166791 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: Accept-Encoding: gzip, deflate Jun 08 01:58:32.166791 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: Connection: keep-alive Jun 08 01:58:32.166791 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: Content-Length: 0 Jun 08 01:58:32.166791 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: Host: 10.222.0.20 Jun 08 01:58:32.166791 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: Openstack-Api-Version: compute 2.90 Jun 08 01:58:32.166791 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: Openstack-System-Scope: None Jun 08 01:58:32.166791 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: User-Agent: python-novaclient Jun 08 01:58:32.166791 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Auth-Token: gAAAAABioAJHueWlpa2TEGQdAMRqTht9DimTbsd_5nmFg9fhYMPjq8ZjC-0RIuZeUEdmGofvwgeBoupod3Q6GMDZIvud-QNbb4jgpA2RbIsD86gBgAehvV3u4QYkG1UltX-A30lOX-5w3Mo5G-9VbpbMhSUOgQmy-ujNT_zXWCuCH5epV-0eVpY Jun 08 01:58:32.166791 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Domain-Id: None Jun 08 01:58:32.166791 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Domain-Name: None Jun 08 01:58:32.166791 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Identity-Status: Confirmed Jun 08 01:58:32.166791 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Is-Admin-Project: True Jun 08 01:58:32.166791 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Openstack-Nova-Api-Version: 2.90 Jun 08 01:58:32.166791 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Project-Domain-Id: default Jun 08 01:58:32.166791 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Project-Domain-Name: Default Jun 08 01:58:32.166791 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Project-Id: d34d18aa450b41d2ac1001da2d9a5476 Jun 08 01:58:32.166791 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Project-Name: admin Jun 08 01:58:32.166791 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Role: reader,admin,member Jun 08 01:58:32.166791 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Roles: reader,admin,member Jun 08 01:58:32.168350 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d34d18aa450b41d2ac1001da2d9a5476"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d34d18aa450b41d2ac1001da2d9a5476", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d34d18aa450b41d2ac1001da2d9a5476"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d34d18aa450b41d2ac1001da2d9a5476"}]}] Jun 08 01:58:32.168350 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Tenant: admin Jun 08 01:58:32.168350 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Tenant-Id: d34d18aa450b41d2ac1001da2d9a5476 Jun 08 01:58:32.168350 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Tenant-Name: admin Jun 08 01:58:32.168350 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-User: admin Jun 08 01:58:32.168350 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-User-Domain-Id: default Jun 08 01:58:32.168350 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-User-Domain-Name: Default Jun 08 01:58:32.168350 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-User-Id: ded448ce0e8547839095b6fee4b26e38 Jun 08 01:58:32.168350 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-User-Name: admin Jun 08 01:58:32.168350 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: method: > Jun 08 01:58:32.168350 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: exception: Flavor 84 could not be found. Jun 08 01:58:32.168350 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: action_args: {'id': '84'} Jun 08 01:58:32.168350 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 01:58:32.168350 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 01:58:32.169453 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 08 01:58:32.169453 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 08 01:58:32.169453 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 08 01:58:32.169453 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 08 01:58:32.169453 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 08 01:58:32.169453 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 08 01:58:32.169453 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 08 01:58:32.169453 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 08 01:58:32.169453 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 08 01:58:32.169453 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 01:58:32.169453 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 08 01:58:32.169453 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 08 01:58:32.169453 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 08 01:58:32.169453 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi Jun 08 01:58:32.169453 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 01:58:32.169453 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi Jun 08 01:58:32.169453 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 01:58:32.169453 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 01:58:32.169453 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 01:58:32.171421 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 01:58:32.171421 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 01:58:32.171421 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 01:58:32.171421 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 01:58:32.171421 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 08 01:58:32.171421 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 08 01:58:32.171421 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 08 01:58:32.171421 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi Jun 08 01:58:32.171421 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 01:58:32.171421 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi Jun 08 01:58:32.171421 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 01:58:32.171421 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 01:58:32.171421 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 01:58:32.171421 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 01:58:32.171421 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 01:58:32.171421 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 08 01:58:32.171421 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi Jun 08 01:58:32.171421 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-fcb7a398-598e-49e2-9a56-1d39cfa8605e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 01:58:32.172791 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-fcb7a398-598e-49e2-9a56-1d39cfa8605e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060463 Jun 08 01:58:32.172791 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Jun 8 01:58:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 08 01:58:32.178548 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-8006de63-2a95-420f-a3ef-02900061e86c admin admin] Calling method '>' {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:58:32.192439 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.requestlog [None req-8006de63-2a95-420f-a3ef-02900061e86c admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017443 Jun 08 01:58:32.192943 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: [pid: 103494|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Jun 8 01:58:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 01:58:32.202712 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-a2ce7d38-9d78-4997-9728-b8f262026c43 admin admin] Calling method '>' {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:58:32.216227 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-a2ce7d38-9d78-4997-9728-b8f262026c43 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017747 Jun 08 01:58:32.216803 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Jun 8 01:58:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 01:58:32.226717 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-e9c135bb-3431-4541-ad19-0742685f4b9e admin admin] Calling method '>' {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:58:32.231978 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.wsgi [None req-e9c135bb-3431-4541-ad19-0742685f4b9e admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 08 01:58:32.233759 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-e9c135bb-3431-4541-ad19-0742685f4b9e admin admin] Request method failure captured: Jun 08 01:58:32.233759 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 08 01:58:32.233759 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: Accept: application/json Jun 08 01:58:32.233759 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: Accept-Encoding: gzip, deflate Jun 08 01:58:32.233759 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: Connection: keep-alive Jun 08 01:58:32.233759 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: Content-Length: 0 Jun 08 01:58:32.233759 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: Host: 10.222.0.20 Jun 08 01:58:32.233759 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: Openstack-Api-Version: compute 2.90 Jun 08 01:58:32.233759 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: Openstack-System-Scope: None Jun 08 01:58:32.233759 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: User-Agent: python-novaclient Jun 08 01:58:32.233759 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Auth-Token: gAAAAABioAJHueWlpa2TEGQdAMRqTht9DimTbsd_5nmFg9fhYMPjq8ZjC-0RIuZeUEdmGofvwgeBoupod3Q6GMDZIvud-QNbb4jgpA2RbIsD86gBgAehvV3u4QYkG1UltX-A30lOX-5w3Mo5G-9VbpbMhSUOgQmy-ujNT_zXWCuCH5epV-0eVpY Jun 08 01:58:32.233759 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Domain-Id: None Jun 08 01:58:32.233759 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Domain-Name: None Jun 08 01:58:32.233759 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Identity-Status: Confirmed Jun 08 01:58:32.233759 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Is-Admin-Project: True Jun 08 01:58:32.233759 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Openstack-Nova-Api-Version: 2.90 Jun 08 01:58:32.233759 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Project-Domain-Id: default Jun 08 01:58:32.233759 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Project-Domain-Name: Default Jun 08 01:58:32.233759 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Project-Id: d34d18aa450b41d2ac1001da2d9a5476 Jun 08 01:58:32.233759 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Project-Name: admin Jun 08 01:58:32.233759 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Role: reader,admin,member Jun 08 01:58:32.233759 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Roles: reader,admin,member Jun 08 01:58:32.235323 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d34d18aa450b41d2ac1001da2d9a5476"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d34d18aa450b41d2ac1001da2d9a5476", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d34d18aa450b41d2ac1001da2d9a5476"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d34d18aa450b41d2ac1001da2d9a5476"}]}] Jun 08 01:58:32.235323 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Tenant: admin Jun 08 01:58:32.235323 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Tenant-Id: d34d18aa450b41d2ac1001da2d9a5476 Jun 08 01:58:32.235323 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Tenant-Name: admin Jun 08 01:58:32.235323 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-User: admin Jun 08 01:58:32.235323 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-User-Domain-Id: default Jun 08 01:58:32.235323 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-User-Domain-Name: Default Jun 08 01:58:32.235323 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-User-Id: ded448ce0e8547839095b6fee4b26e38 Jun 08 01:58:32.235323 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-User-Name: admin Jun 08 01:58:32.235323 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: method: > Jun 08 01:58:32.235323 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: exception: Flavor 84 could not be found. Jun 08 01:58:32.235323 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: action_args: {'id': '84'} Jun 08 01:58:32.235323 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 01:58:32.235323 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 01:58:32.236384 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 08 01:58:32.236384 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 08 01:58:32.236384 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 08 01:58:32.236384 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 08 01:58:32.236384 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 08 01:58:32.236384 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 08 01:58:32.236384 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 08 01:58:32.236384 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 08 01:58:32.236384 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 08 01:58:32.236384 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 01:58:32.236384 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 08 01:58:32.236384 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 08 01:58:32.236384 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 08 01:58:32.236384 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi Jun 08 01:58:32.236384 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 01:58:32.236384 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi Jun 08 01:58:32.236384 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 01:58:32.236384 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 01:58:32.236384 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 01:58:32.237898 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 01:58:32.237898 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 01:58:32.237898 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 01:58:32.237898 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 01:58:32.237898 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 08 01:58:32.237898 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 08 01:58:32.237898 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 08 01:58:32.237898 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi Jun 08 01:58:32.237898 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 01:58:32.237898 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi Jun 08 01:58:32.237898 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 01:58:32.237898 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 01:58:32.237898 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 01:58:32.237898 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 01:58:32.237898 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 01:58:32.237898 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 08 01:58:32.237898 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi Jun 08 01:58:32.237898 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-e9c135bb-3431-4541-ad19-0742685f4b9e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 01:58:32.239169 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.requestlog [None req-e9c135bb-3431-4541-ad19-0742685f4b9e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011880 Jun 08 01:58:32.239169 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: [pid: 103494|app: 0|req: 23/47] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Jun 8 01:58:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 08 01:58:33.112672 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-a2ce7d38-9d78-4997-9728-b8f262026c43 admin admin] Calling method '>' {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:58:33.113698 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-a2ce7d38-9d78-4997-9728-b8f262026c43 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jun 08 01:58:33.114096 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 25/48] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Jun 8 01:58:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 01:58:33.305147 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-294d637b-0055-43ff-ba0c-5fcb57dc6cda admin admin] Calling method '>' {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:58:33.311412 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.wsgi [None req-294d637b-0055-43ff-ba0c-5fcb57dc6cda admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 08 01:58:33.312945 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-294d637b-0055-43ff-ba0c-5fcb57dc6cda admin admin] Request method failure captured: Jun 08 01:58:33.312945 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 08 01:58:33.312945 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: Accept: application/json Jun 08 01:58:33.312945 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: Accept-Encoding: gzip, deflate Jun 08 01:58:33.312945 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: Connection: keep-alive Jun 08 01:58:33.312945 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: Content-Length: 0 Jun 08 01:58:33.312945 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: Host: 10.222.0.20 Jun 08 01:58:33.312945 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: Openstack-Api-Version: compute 2.90 Jun 08 01:58:33.312945 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: Openstack-System-Scope: None Jun 08 01:58:33.312945 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: User-Agent: python-novaclient Jun 08 01:58:33.312945 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Auth-Token: gAAAAABioAJJW5VtubJ4rJDFrXLnBMHWq7SFt2UZBmOFnuydJGKLRH2FR6egWzTizZYrKPnIwVwwSEtE8R8j-78HFs2jlgT6Ej9MrreSejm-Sl9ciUt6A7OsjNcO6oO4_pFnVW7lmZE_eRRgK8rqhtIpCfweYsCcVEt9IbBZS3zErcY513y_bz8 Jun 08 01:58:33.312945 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Domain-Id: None Jun 08 01:58:33.312945 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Domain-Name: None Jun 08 01:58:33.312945 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Identity-Status: Confirmed Jun 08 01:58:33.312945 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Is-Admin-Project: True Jun 08 01:58:33.312945 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Openstack-Nova-Api-Version: 2.90 Jun 08 01:58:33.312945 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Project-Domain-Id: default Jun 08 01:58:33.312945 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Project-Domain-Name: Default Jun 08 01:58:33.312945 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Project-Id: d34d18aa450b41d2ac1001da2d9a5476 Jun 08 01:58:33.312945 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Project-Name: admin Jun 08 01:58:33.312945 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Role: reader,admin,member Jun 08 01:58:33.312945 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Roles: reader,admin,member Jun 08 01:58:33.314478 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d34d18aa450b41d2ac1001da2d9a5476"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d34d18aa450b41d2ac1001da2d9a5476", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d34d18aa450b41d2ac1001da2d9a5476"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d34d18aa450b41d2ac1001da2d9a5476"}]}] Jun 08 01:58:33.314478 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Tenant: admin Jun 08 01:58:33.314478 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Tenant-Id: d34d18aa450b41d2ac1001da2d9a5476 Jun 08 01:58:33.314478 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-Tenant-Name: admin Jun 08 01:58:33.314478 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-User: admin Jun 08 01:58:33.314478 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-User-Domain-Id: default Jun 08 01:58:33.314478 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-User-Domain-Name: Default Jun 08 01:58:33.314478 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-User-Id: ded448ce0e8547839095b6fee4b26e38 Jun 08 01:58:33.314478 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: X-User-Name: admin Jun 08 01:58:33.314478 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: method: > Jun 08 01:58:33.314478 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: exception: Flavor 451 could not be found. Jun 08 01:58:33.314478 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: action_args: {'id': '451'} Jun 08 01:58:33.314478 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 01:58:33.314478 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 01:58:33.315505 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 08 01:58:33.315505 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 08 01:58:33.315505 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 08 01:58:33.315505 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 08 01:58:33.315505 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 08 01:58:33.315505 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 08 01:58:33.315505 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 08 01:58:33.315505 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 08 01:58:33.315505 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 08 01:58:33.315505 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 01:58:33.315505 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 08 01:58:33.315505 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 08 01:58:33.315505 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 08 01:58:33.315505 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi Jun 08 01:58:33.315505 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 01:58:33.315505 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi Jun 08 01:58:33.315505 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 01:58:33.315505 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 01:58:33.315505 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 01:58:33.317066 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 01:58:33.317066 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 01:58:33.317066 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 01:58:33.317066 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 01:58:33.317066 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 08 01:58:33.317066 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 08 01:58:33.317066 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 08 01:58:33.317066 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi Jun 08 01:58:33.317066 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 01:58:33.317066 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi Jun 08 01:58:33.317066 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 01:58:33.317066 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 01:58:33.317066 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 01:58:33.317066 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 01:58:33.317066 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 01:58:33.317066 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 08 01:58:33.317066 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: ERROR nova.api.openstack.wsgi Jun 08 01:58:33.317066 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-294d637b-0055-43ff-ba0c-5fcb57dc6cda admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 01:58:33.318469 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.requestlog [None req-294d637b-0055-43ff-ba0c-5fcb57dc6cda admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061176 Jun 08 01:58:33.318469 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: [pid: 103494|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Jun 8 01:58:33 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 08 01:58:33.324153 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-07faf44c-047e-4f7d-8d4d-a7cdef73c0c3 admin admin] Calling method '>' {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:58:33.338685 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-07faf44c-047e-4f7d-8d4d-a7cdef73c0c3 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018306 Jun 08 01:58:33.339214 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 26/50] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Jun 8 01:58:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 01:58:33.349161 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-eb1c63c0-fe7d-483e-aee6-03b3df9dc261 admin admin] Calling method '>' {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:58:33.362853 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.requestlog [None req-eb1c63c0-fe7d-483e-aee6-03b3df9dc261 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017232 Jun 08 01:58:33.363377 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: [pid: 103494|app: 0|req: 25/51] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Jun 8 01:58:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 01:58:33.372195 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-e2f87dac-0d0d-471e-a26e-63325b77374e admin admin] Calling method '>' {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:58:33.378577 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.wsgi [None req-e2f87dac-0d0d-471e-a26e-63325b77374e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 08 01:58:33.380056 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-e2f87dac-0d0d-471e-a26e-63325b77374e admin admin] Request method failure captured: Jun 08 01:58:33.380056 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 08 01:58:33.380056 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: Accept: application/json Jun 08 01:58:33.380056 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: Accept-Encoding: gzip, deflate Jun 08 01:58:33.380056 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: Connection: keep-alive Jun 08 01:58:33.380056 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: Content-Length: 0 Jun 08 01:58:33.380056 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: Host: 10.222.0.20 Jun 08 01:58:33.380056 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: Openstack-Api-Version: compute 2.90 Jun 08 01:58:33.380056 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: Openstack-System-Scope: None Jun 08 01:58:33.380056 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: User-Agent: python-novaclient Jun 08 01:58:33.380056 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Auth-Token: gAAAAABioAJJW5VtubJ4rJDFrXLnBMHWq7SFt2UZBmOFnuydJGKLRH2FR6egWzTizZYrKPnIwVwwSEtE8R8j-78HFs2jlgT6Ej9MrreSejm-Sl9ciUt6A7OsjNcO6oO4_pFnVW7lmZE_eRRgK8rqhtIpCfweYsCcVEt9IbBZS3zErcY513y_bz8 Jun 08 01:58:33.380056 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Domain-Id: None Jun 08 01:58:33.380056 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Domain-Name: None Jun 08 01:58:33.380056 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Identity-Status: Confirmed Jun 08 01:58:33.380056 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Is-Admin-Project: True Jun 08 01:58:33.380056 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Openstack-Nova-Api-Version: 2.90 Jun 08 01:58:33.380056 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Project-Domain-Id: default Jun 08 01:58:33.380056 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Project-Domain-Name: Default Jun 08 01:58:33.380056 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Project-Id: d34d18aa450b41d2ac1001da2d9a5476 Jun 08 01:58:33.380056 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Project-Name: admin Jun 08 01:58:33.380056 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Role: reader,admin,member Jun 08 01:58:33.380056 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Roles: reader,admin,member Jun 08 01:58:33.381728 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d34d18aa450b41d2ac1001da2d9a5476"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d34d18aa450b41d2ac1001da2d9a5476", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d34d18aa450b41d2ac1001da2d9a5476"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d34d18aa450b41d2ac1001da2d9a5476"}]}] Jun 08 01:58:33.381728 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Tenant: admin Jun 08 01:58:33.381728 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Tenant-Id: d34d18aa450b41d2ac1001da2d9a5476 Jun 08 01:58:33.381728 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-Tenant-Name: admin Jun 08 01:58:33.381728 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-User: admin Jun 08 01:58:33.381728 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-User-Domain-Id: default Jun 08 01:58:33.381728 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-User-Domain-Name: Default Jun 08 01:58:33.381728 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-User-Id: ded448ce0e8547839095b6fee4b26e38 Jun 08 01:58:33.381728 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: X-User-Name: admin Jun 08 01:58:33.381728 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: method: > Jun 08 01:58:33.381728 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: exception: Flavor 451 could not be found. Jun 08 01:58:33.381728 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: action_args: {'id': '451'} Jun 08 01:58:33.381728 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 01:58:33.381728 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 01:58:33.382766 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 08 01:58:33.382766 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 08 01:58:33.382766 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 08 01:58:33.382766 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 08 01:58:33.382766 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 08 01:58:33.382766 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 08 01:58:33.382766 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 08 01:58:33.382766 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 08 01:58:33.382766 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 08 01:58:33.382766 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 01:58:33.382766 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 08 01:58:33.382766 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 08 01:58:33.382766 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 08 01:58:33.382766 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi Jun 08 01:58:33.382766 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 01:58:33.382766 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi Jun 08 01:58:33.382766 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 01:58:33.382766 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 01:58:33.382766 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 01:58:33.383991 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 01:58:33.383991 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 01:58:33.383991 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 01:58:33.383991 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 01:58:33.383991 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 08 01:58:33.383991 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 08 01:58:33.383991 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 08 01:58:33.383991 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi Jun 08 01:58:33.383991 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 01:58:33.383991 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi Jun 08 01:58:33.383991 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 01:58:33.383991 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 01:58:33.383991 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 01:58:33.383991 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 01:58:33.383991 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 01:58:33.383991 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 08 01:58:33.383991 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: ERROR nova.api.openstack.wsgi Jun 08 01:58:33.383991 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-e2f87dac-0d0d-471e-a26e-63325b77374e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 01:58:33.385478 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-e2f87dac-0d0d-471e-a26e-63325b77374e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012670 Jun 08 01:58:33.385478 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Jun 8 01:58:33 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 08 01:58:34.258111 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-eb1c63c0-fe7d-483e-aee6-03b3df9dc261 admin admin] Calling method '>' {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:58:34.259130 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.requestlog [None req-eb1c63c0-fe7d-483e-aee6-03b3df9dc261 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jun 08 01:58:34.259528 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: [pid: 103494|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Jun 8 01:58:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 01:58:34.447977 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-cbb7e3a2-4eeb-4083-8478-6dbe37765a17 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 01:58:34.466035 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-cbb7e3a2-4eeb-4083-8478-6dbe37765a17 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.070241 Jun 08 01:58:34.466584 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 28/54] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Jun 8 01:58:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 08 01:58:35.329843 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-eb1c63c0-fe7d-483e-aee6-03b3df9dc261 admin admin] Calling method '>' {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:58:35.330856 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.requestlog [None req-eb1c63c0-fe7d-483e-aee6-03b3df9dc261 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jun 08 01:58:35.331259 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: [pid: 103494|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Jun 8 01:58:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 01:58:35.520445 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-f8414584-bc4a-4dde-a69a-363424057e90 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 01:58:35.538117 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-f8414584-bc4a-4dde-a69a-363424057e90 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068130 Jun 08 01:58:35.538993 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 29/56] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Jun 8 01:58:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 08 01:58:36.402885 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-eb1c63c0-fe7d-483e-aee6-03b3df9dc261 admin admin] Calling method '>' {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:58:36.403891 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.requestlog [None req-eb1c63c0-fe7d-483e-aee6-03b3df9dc261 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jun 08 01:58:36.404289 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: [pid: 103494|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Jun 8 01:58:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 01:58:36.598537 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-eb213967-23a1-4d6b-b0e2-57142babb303 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 01:58:36.615856 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-eb213967-23a1-4d6b-b0e2-57142babb303 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.075754 Jun 08 01:58:36.616363 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 30/58] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Jun 8 01:58:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 08 01:58:37.487652 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-eb1c63c0-fe7d-483e-aee6-03b3df9dc261 admin admin] Calling method '>' {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:58:37.488708 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.requestlog [None req-eb1c63c0-fe7d-483e-aee6-03b3df9dc261 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jun 08 01:58:37.489137 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: [pid: 103494|app: 0|req: 29/59] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Jun 8 01:58:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 01:58:37.681751 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-e59aa1c1-2a68-4444-917f-227dbe539c71 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 01:58:37.700005 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-e59aa1c1-2a68-4444-917f-227dbe539c71 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.076207 Jun 08 01:58:37.700511 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 31/60] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Jun 8 01:58:37 2022] POST /compute/v2.1/flavors => generated 409 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 08 01:58:38.566219 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-eb1c63c0-fe7d-483e-aee6-03b3df9dc261 admin admin] Calling method '>' {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:58:38.567227 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.requestlog [None req-eb1c63c0-fe7d-483e-aee6-03b3df9dc261 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jun 08 01:58:38.567624 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: [pid: 103494|app: 0|req: 30/61] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Jun 8 01:58:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 01:58:38.754214 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-32a168e8-51f0-485a-b24b-644894f73d03 admin admin] Calling method '>' {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:58:38.774150 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-32a168e8-51f0-485a-b24b-644894f73d03 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069842 Jun 08 01:58:38.774690 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 32/62] 10.222.0.20 () {60 vars in 1202 bytes} [Wed Jun 8 01:58:38 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 01:59:40.265506 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-eb1c63c0-fe7d-483e-aee6-03b3df9dc261 admin admin] Calling method '>' {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:59:40.266569 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.requestlog [None req-eb1c63c0-fe7d-483e-aee6-03b3df9dc261 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001576 Jun 08 01:59:40.266982 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: [pid: 103494|app: 0|req: 31/63] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jun 8 01:59:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 01:59:40.274211 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG dbcounter [-] [103495] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 01:59:40.333737 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-9a822a15-03f9-4fd8-9a09-162304a9027a admin admin] Calling method '>' {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:59:40.357520 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-9a822a15-03f9-4fd8-9a09-162304a9027a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.084319 Jun 08 01:59:40.358078 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 33/64] 10.222.0.20 () {60 vars in 1291 bytes} [Wed Jun 8 01:59:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 01:59:40.383707 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-80d71896-9deb-49d5-a79b-c5d67b837268 admin admin] Calling method '>' {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:59:40.387356 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG dbcounter [-] [103494] Writing DB stats nova_api:SELECT=14 {{(pid=103494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 01:59:40.395577 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.requestlog [None req-80d71896-9deb-49d5-a79b-c5d67b837268 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017188 Jun 08 01:59:40.396602 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: [pid: 103494|app: 0|req: 32/65] 10.222.0.20 () {60 vars in 1282 bytes} [Wed Jun 8 01:59:40 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 01:59:40.409136 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-89bf5adf-0aa1-4d8b-9fa8-c85bf0e143d0 admin admin] Calling method '>' {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:59:40.419419 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-89bf5adf-0aa1-4d8b-9fa8-c85bf0e143d0 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013667 Jun 08 01:59:40.420379 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 34/66] 10.222.0.20 () {60 vars in 1285 bytes} [Wed Jun 8 01:59:40 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 01:59:40.434169 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-6a9dc08c-4c3d-4732-9ce3-cb47de8048a7 admin admin] Calling method '>' {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:59:40.443798 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.requestlog [None req-6a9dc08c-4c3d-4732-9ce3-cb47de8048a7 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014347 Jun 08 01:59:40.444380 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: [pid: 103494|app: 0|req: 33/67] 10.222.0.20 () {60 vars in 1285 bytes} [Wed Jun 8 01:59:40 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 01:59:40.460813 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-f9d31291-1df2-44d6-8779-2a87ed1441bc admin admin] Calling method '>' {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 01:59:40.469443 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-f9d31291-1df2-44d6-8779-2a87ed1441bc admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013106 Jun 08 01:59:40.469994 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 35/68] 10.222.0.20 () {60 vars in 1282 bytes} [Wed Jun 8 01:59:40 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:03:18.952882 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-6a9dc08c-4c3d-4732-9ce3-cb47de8048a7 admin admin] Calling method '>' {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:03:18.953899 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.requestlog [None req-6a9dc08c-4c3d-4732-9ce3-cb47de8048a7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jun 08 02:03:18.954303 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: [pid: 103494|app: 0|req: 34/69] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Jun 8 02:03:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:03:19.110855 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG dbcounter [-] [103495] Writing DB stats nova_api:SELECT=6 {{(pid=103495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:03:19.224076 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-1fc4c8e7-e42a-4185-9333-35750db2b0ce admin admin] Calling method '>' {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:03:19.225323 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 08 02:03:19.225323 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: warnings.warn(msg) Jun 08 02:03:19.226592 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG oslo_concurrency.lockutils [None req-1fc4c8e7-e42a-4185-9333-35750db2b0ce admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:03:19.227040 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG oslo_concurrency.lockutils [None req-1fc4c8e7-e42a-4185-9333-35750db2b0ce admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:03:19.228696 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG oslo_concurrency.lockutils [None req-1fc4c8e7-e42a-4185-9333-35750db2b0ce admin admin] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:03:19.229197 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG oslo_concurrency.lockutils [None req-1fc4c8e7-e42a-4185-9333-35750db2b0ce admin admin] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:03:19.263858 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-1fc4c8e7-e42a-4185-9333-35750db2b0ce admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.154624 Jun 08 02:03:19.264441 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 36/70] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Jun 8 02:03:19 2022] GET /compute/v2.1/os-services => generated 791 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 08 02:03:20.150172 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-6a9dc08c-4c3d-4732-9ce3-cb47de8048a7 admin admin] Calling method '>' {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:03:20.151190 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.requestlog [None req-6a9dc08c-4c3d-4732-9ce3-cb47de8048a7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002078 Jun 08 02:03:20.151591 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: [pid: 103494|app: 0|req: 35/71] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Jun 8 02:03:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:03:20.347060 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-dea893f1-2dff-4a90-9291-b098178c4cbc admin admin] Calling method '>' {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:03:20.348223 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 08 02:03:20.348223 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: warnings.warn(msg) Jun 08 02:03:20.349449 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG oslo_concurrency.lockutils [None req-dea893f1-2dff-4a90-9291-b098178c4cbc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:03:20.349910 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG oslo_concurrency.lockutils [None req-dea893f1-2dff-4a90-9291-b098178c4cbc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:03:20.350715 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG oslo_concurrency.lockutils [None req-dea893f1-2dff-4a90-9291-b098178c4cbc admin admin] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:03:20.351137 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG oslo_concurrency.lockutils [None req-dea893f1-2dff-4a90-9291-b098178c4cbc admin admin] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:03:20.371809 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-dea893f1-2dff-4a90-9291-b098178c4cbc admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.081891 Jun 08 02:03:20.372414 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 37/72] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Jun 8 02:03:20 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 08 02:03:31.657755 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-6a9dc08c-4c3d-4732-9ce3-cb47de8048a7 admin admin] Calling method '>' {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:03:31.658741 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.requestlog [None req-6a9dc08c-4c3d-4732-9ce3-cb47de8048a7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Jun 08 02:03:31.659131 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: [pid: 103494|app: 0|req: 36/73] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Jun 8 02:03:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:03:31.800326 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG dbcounter [-] [103495] Writing DB stats nova_cell0:SELECT=4 {{(pid=103495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:03:31.801068 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG dbcounter [-] [103495] Writing DB stats nova_cell1:SELECT=4 {{(pid=103495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:03:31.801672 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG dbcounter [-] [103495] Writing DB stats nova_api:SELECT=8 {{(pid=103495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:03:31.849237 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-76798d0f-7931-4c51-90d3-2510ea982b2d admin admin] Calling method '>' {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:03:31.850405 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 08 02:03:31.850405 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: warnings.warn(msg) Jun 08 02:03:31.851582 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG oslo_concurrency.lockutils [None req-76798d0f-7931-4c51-90d3-2510ea982b2d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:03:31.852025 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG oslo_concurrency.lockutils [None req-76798d0f-7931-4c51-90d3-2510ea982b2d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:03:31.853718 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG oslo_concurrency.lockutils [None req-76798d0f-7931-4c51-90d3-2510ea982b2d admin admin] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:03:31.854155 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG oslo_concurrency.lockutils [None req-76798d0f-7931-4c51-90d3-2510ea982b2d admin admin] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:03:31.880364 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-76798d0f-7931-4c51-90d3-2510ea982b2d admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.084388 Jun 08 02:03:31.880891 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 38/74] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Jun 8 02:03:31 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:03:32.759356 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: DEBUG nova.api.openstack.wsgi [None req-6a9dc08c-4c3d-4732-9ce3-cb47de8048a7 admin admin] Calling method '>' {{(pid=103494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:03:32.760363 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: INFO nova.api.openstack.requestlog [None req-6a9dc08c-4c3d-4732-9ce3-cb47de8048a7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001788 Jun 08 02:03:32.760791 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: [pid: 103494|app: 0|req: 37/75] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Jun 8 02:03:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:03:32.954594 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG nova.api.openstack.wsgi [None req-c140252d-1c4e-4af1-84c6-b9e43f83fdb3 admin admin] Calling method '>' {{(pid=103495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:03:32.955762 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 08 02:03:32.955762 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: warnings.warn(msg) Jun 08 02:03:32.956983 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG oslo_concurrency.lockutils [None req-c140252d-1c4e-4af1-84c6-b9e43f83fdb3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:03:32.957427 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG oslo_concurrency.lockutils [None req-c140252d-1c4e-4af1-84c6-b9e43f83fdb3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:03:32.958216 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG oslo_concurrency.lockutils [None req-c140252d-1c4e-4af1-84c6-b9e43f83fdb3 admin admin] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:03:32.958649 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: DEBUG oslo_concurrency.lockutils [None req-c140252d-1c4e-4af1-84c6-b9e43f83fdb3 admin admin] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:03:32.982008 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: INFO nova.api.openstack.requestlog [None req-c140252d-1c4e-4af1-84c6-b9e43f83fdb3 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081890 Jun 08 02:03:32.982507 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: [pid: 103495|app: 0|req: 39/76] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Jun 8 02:03:32 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:04:32.029210 dv-cinder-845069-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 08 02:04:32.030083 dv-cinder-845069-1-iscsi devstack@n-api.service[103493]: Wed Jun 8 02:04:32 2022 - graceful shutdown triggered... Jun 08 02:04:32.030584 dv-cinder-845069-1-iscsi devstack@n-api.service[103494]: Gracefully killing worker 1 (pid: 103494)... Jun 08 02:04:32.030942 dv-cinder-845069-1-iscsi devstack@n-api.service[103495]: Gracefully killing worker 2 (pid: 103495)... Jun 08 02:04:33.031221 dv-cinder-845069-1-iscsi devstack@n-api.service[103493]: worker 1 buried after 1 seconds Jun 08 02:04:33.031221 dv-cinder-845069-1-iscsi devstack@n-api.service[103493]: worker 2 buried after 1 seconds Jun 08 02:04:33.031221 dv-cinder-845069-1-iscsi devstack@n-api.service[103493]: goodbye to uWSGI. Jun 08 02:04:33.032835 dv-cinder-845069-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 08 02:04:33.033402 dv-cinder-845069-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 08 02:04:33.036081 dv-cinder-845069-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 08 02:04:33.054334 dv-cinder-845069-1-iscsi devstack@n-api.service[117922]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 08 02:04:33.076969 dv-cinder-845069-1-iscsi devstack@n-api.service[117922]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 8 02:04:33 2022] *** Jun 08 02:04:33.076969 dv-cinder-845069-1-iscsi devstack@n-api.service[117922]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 08 02:04:33.076969 dv-cinder-845069-1-iscsi devstack@n-api.service[117922]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 08 02:04:33.076969 dv-cinder-845069-1-iscsi devstack@n-api.service[117922]: nodename: dv-cinder-845069-1-iscsi Jun 08 02:04:33.076969 dv-cinder-845069-1-iscsi devstack@n-api.service[117922]: machine: x86_64 Jun 08 02:04:33.076969 dv-cinder-845069-1-iscsi devstack@n-api.service[117922]: clock source: unix Jun 08 02:04:33.076969 dv-cinder-845069-1-iscsi devstack@n-api.service[117922]: pcre jit disabled Jun 08 02:04:33.076969 dv-cinder-845069-1-iscsi devstack@n-api.service[117922]: detected number of CPU cores: 4 Jun 08 02:04:33.076969 dv-cinder-845069-1-iscsi devstack@n-api.service[117922]: current working directory: / Jun 08 02:04:33.076969 dv-cinder-845069-1-iscsi devstack@n-api.service[117922]: detected binary path: /usr/bin/uwsgi-core Jun 08 02:04:33.076969 dv-cinder-845069-1-iscsi devstack@n-api.service[117922]: your processes number limit is 47680 Jun 08 02:04:33.077830 dv-cinder-845069-1-iscsi devstack@n-api.service[117922]: your memory page size is 4096 bytes Jun 08 02:04:33.077830 dv-cinder-845069-1-iscsi devstack@n-api.service[117922]: detected max file descriptor number: 2048 Jun 08 02:04:33.077830 dv-cinder-845069-1-iscsi devstack@n-api.service[117922]: lock engine: pthread robust mutexes Jun 08 02:04:33.077830 dv-cinder-845069-1-iscsi devstack@n-api.service[117922]: thunder lock: enabled Jun 08 02:04:33.077830 dv-cinder-845069-1-iscsi devstack@n-api.service[117922]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 08 02:04:33.077830 dv-cinder-845069-1-iscsi devstack@n-api.service[117922]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 08 02:04:33.127620 dv-cinder-845069-1-iscsi devstack@n-api.service[117922]: Python main interpreter initialized at 0x55de0507e9c0 Jun 08 02:04:33.127620 dv-cinder-845069-1-iscsi devstack@n-api.service[117922]: python threads support enabled Jun 08 02:04:33.127620 dv-cinder-845069-1-iscsi devstack@n-api.service[117922]: your server socket listen backlog is limited to 100 connections Jun 08 02:04:33.127620 dv-cinder-845069-1-iscsi devstack@n-api.service[117922]: your mercy for graceful operations on workers is 90 seconds Jun 08 02:04:33.128077 dv-cinder-845069-1-iscsi devstack@n-api.service[117922]: mapped 403077 bytes (393 KB) for 2 cores Jun 08 02:04:33.128077 dv-cinder-845069-1-iscsi devstack@n-api.service[117922]: *** Operational MODE: preforking *** Jun 08 02:04:33.128322 dv-cinder-845069-1-iscsi devstack@n-api.service[117922]: *** uWSGI is running in multiple interpreter mode *** Jun 08 02:04:33.128322 dv-cinder-845069-1-iscsi devstack@n-api.service[117922]: spawned uWSGI master process (pid: 117922) Jun 08 02:04:33.128547 dv-cinder-845069-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 08 02:04:33.129157 dv-cinder-845069-1-iscsi devstack@n-api.service[117922]: spawned uWSGI worker 1 (pid: 117938, cores: 1) Jun 08 02:04:33.129507 dv-cinder-845069-1-iscsi devstack@n-api.service[117922]: spawned uWSGI worker 2 (pid: 117939, cores: 1) Jun 08 02:04:33.129829 dv-cinder-845069-1-iscsi devstack@n-api.service[117922]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 08 02:04:34.371964 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 08 02:04:34.405396 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 08 02:04:35.208448 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 08 02:04:35.208448 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: from cryptography.utils import int_from_bytes Jun 08 02:04:35.208758 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 08 02:04:35.208758 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: from cryptography.utils import int_from_bytes Jun 08 02:04:35.268364 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 08 02:04:35.268364 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: from cryptography.utils import int_from_bytes Jun 08 02:04:35.268680 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 08 02:04:35.268680 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: from cryptography.utils import int_from_bytes Jun 08 02:04:37.585511 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 08 02:04:37.586076 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 08 02:04:37.586288 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 08 02:04:37.586654 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 08 02:04:37.587147 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 08 02:04:37.587550 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.587879 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.588202 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.588553 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.588888 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.589201 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.589523 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.589848 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.590174 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.590436 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.590751 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.591079 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845069-1-iscsi {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.591402 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.591712 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.592030 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.592346 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.592680 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.593006 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.593315 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.593814 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.594262 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.594586 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.594886 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.595226 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.595542 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.595853 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.596174 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.596510 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.596835 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.597145 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.597541 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845069-1-iscsi {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.597862 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.598175 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.598490 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.598907 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.599218 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.599526 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.599845 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.600168 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.600501 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.600830 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.601150 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.601468 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.601787 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.602088 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.602924 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.603242 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.603563 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.603869 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.604173 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.604446 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.604757 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.605083 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.605409 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.605730 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.605984 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.606236 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.606555 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.606874 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.607182 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.607488 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.607793 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.608098 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.608412 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.608731 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.609037 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.609342 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.609661 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.609975 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.610297 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.610605 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.610924 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.611321 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.611574 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.611882 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.612223 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.612579 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.612886 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.613205 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.613526 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.613833 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.614139 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.614445 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.614766 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.615105 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.615414 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.615665 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.615968 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.616277 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.616627 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.616932 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.617238 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.617542 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.617842 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.618703 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.619018 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.619322 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.619626 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.619931 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.620236 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.620569 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.620880 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.621186 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.621504 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.621824 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.622127 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.622432 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.622736 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.623040 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.623363 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.623666 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.623971 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.624291 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.624623 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.624928 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.625251 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.625564 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.625867 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.626185 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.626487 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.626791 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.627111 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.627419 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.627726 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.628030 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.628335 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.628668 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.628973 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.629275 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.629581 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.629882 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.630203 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.630525 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.630834 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.631139 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.631444 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.631764 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.632100 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.632456 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.632802 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.633117 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.633455 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.633817 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.634133 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.634452 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.634762 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.635090 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.635410 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.635760 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.636075 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.636417 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.636738 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.637072 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.637390 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.637711 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.638029 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.638340 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.638659 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.638990 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.639314 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.639676 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.639971 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.640317 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.640673 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.641002 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.641325 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.641638 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.641950 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.642262 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.642588 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.642921 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.643233 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.643555 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.643866 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.644180 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.644519 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.644833 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.645145 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.645493 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.645809 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.646129 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.646442 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.646762 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.647075 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.647389 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.647700 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.648008 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.648316 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.648655 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.648966 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.649298 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.649623 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.649960 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.650265 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.650601 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.650911 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.651228 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.651541 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.651853 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.652162 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.652497 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.652814 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.653120 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.653444 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.653759 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.654061 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.654384 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.654690 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.654995 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.655313 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.655629 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.655943 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.656254 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.656590 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.656916 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.657235 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.657548 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.657883 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.658215 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.658521 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.658848 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.659175 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.659494 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.659801 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.660113 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.660443 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.660755 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.661062 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.661373 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.661678 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.662238 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.662543 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.662848 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.663152 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.663475 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.663789 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.664091 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.664424 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.664729 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.665589 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.665983 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.666251 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.666587 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.666909 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.667236 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.667553 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.667874 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.668191 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.668536 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.668853 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.669168 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.669492 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.669806 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.670129 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.670442 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.670773 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.671086 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.671408 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.671716 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.672034 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.672379 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.672748 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.673074 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.673396 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.673711 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.674031 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.674341 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.674652 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.674964 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.675277 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.675599 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.675941 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.676236 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.676574 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.676903 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.677216 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.677540 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.677845 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.677977 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 08 02:04:37.678445 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 08 02:04:37.678582 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.678582 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.678843 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 08 02:04:37.678971 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.679098 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 08 02:04:37.679236 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.679372 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 08 02:04:37.679511 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.679639 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.679776 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.679906 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.680033 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.680221 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.680362 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.680712 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.680948 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.681180 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.681385 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.681521 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.681664 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.681795 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.681922 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.682048 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.682175 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.682345 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.682486 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.682662 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.682801 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.682971 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.683133 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.683290 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.683421 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845069-1-iscsi {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.683602 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.683743 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.683908 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.684053 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.684256 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.684436 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.684580 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.684711 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.684845 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.684978 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.685150 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.685291 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.685456 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.685613 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.685789 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.685957 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.686200 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.686341 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.686491 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.686754 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.686889 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.687017 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.687159 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.687289 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.687423 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.687565 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.687771 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.687911 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.688049 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.688186 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.688314 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.688483 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.688622 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.688751 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.688892 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.689021 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.689156 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.689363 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845069-1-iscsi {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.689496 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.689677 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.689830 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.690030 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.690173 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.690311 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.690454 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.690659 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.690799 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.690971 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.691111 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.691280 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.691421 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.691591 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.691730 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.691906 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.692045 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.692210 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.692353 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.692546 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.692692 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.692862 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.692995 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.693177 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.693316 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.693490 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.693649 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.693785 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.693918 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.694076 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.694234 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.694363 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.694496 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.694682 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.694815 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.694983 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.695115 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.695286 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.695535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.695672 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.695840 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.695980 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.696694 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.697098 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.697327 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.697539 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.697699 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.697699 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.698063 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.698200 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.698332 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.698467 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.698675 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.698807 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.698935 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.699069 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.699069 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.699323 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.699461 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.699598 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.699736 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.699873 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.700010 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.700146 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.700281 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.700428 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.700558 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.700700 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.700835 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.700971 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.701117 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.701253 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.701389 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.701519 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.701933 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.701933 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.702156 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.702292 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.702435 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.702555 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.702663 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.702823 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.702956 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.703120 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.703298 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.703538 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.703709 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.703854 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.703974 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.704162 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.704298 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.704557 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.704695 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.705077 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.705236 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.705367 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.705531 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.705664 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.705784 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.706031 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.706175 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.706314 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.706443 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.706599 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.706785 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.707015 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.707221 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.707363 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.707513 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.707641 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.707851 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.708013 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.708156 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.708498 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.708635 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.708635 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.708870 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.708987 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.709128 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.709289 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.709523 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.709664 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.709794 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.709931 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.710074 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.710211 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.710338 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.710464 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.710598 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.710736 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.710872 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.711010 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.711170 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.711303 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.711486 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.711618 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.712450 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.712690 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.712905 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.713075 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.713216 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.713345 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.713486 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.713629 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.713765 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.713893 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.714020 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.714156 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.714284 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.714459 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.714601 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.714785 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.714925 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.715092 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.715225 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.715397 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.715539 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.715715 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.715854 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.716020 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.716163 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.716325 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.716493 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.716669 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.716808 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.717047 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.717206 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.717403 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.717545 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.717682 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.717818 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.717946 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.718074 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.718211 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.718362 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.718578 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.718711 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.718838 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.718973 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.719110 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.719249 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.719379 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.719514 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.719642 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.719768 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.719907 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.720044 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.720196 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.720329 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.720521 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.720654 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.720827 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.720961 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.721126 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.721258 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.721444 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.721585 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.721766 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.721898 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.722074 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.722213 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.722379 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.722525 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.722685 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.722814 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.722993 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.723132 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 02:04:37.723301 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.723445 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.723613 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.723751 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.723919 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.724059 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.724227 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.724367 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.724562 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.724695 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.724873 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.725006 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.725179 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.725321 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.725506 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.725640 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.725819 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.725970 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.726171 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.726302 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.726437 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.726572 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.726701 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.726836 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.727030 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.727255 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.727429 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.727680 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.727680 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.728108 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.728290 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.728506 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.728745 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.728887 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.729022 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.729166 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.729295 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.729423 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.729550 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.729677 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.729805 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.729941 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.730069 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.730195 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.730329 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.730458 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.730585 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.730721 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.730858 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.730993 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.731122 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.731249 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.731375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.731531 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.731722 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.731853 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.731988 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.732124 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.732296 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.732449 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.732631 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.732763 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.732943 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.733075 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.733264 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.733406 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.733595 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.733728 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.733908 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.734047 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.734222 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.734362 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.734533 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.734670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.734841 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.734971 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.735152 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.735290 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.735461 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.735590 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.735772 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.735913 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.736091 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.736231 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.736421 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.736568 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.736745 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.736889 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.737054 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.737185 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.737401 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.737532 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.737681 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.737892 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.738033 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.738163 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.738298 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.738425 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.738553 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.738689 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.738911 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.739042 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.739178 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.739317 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.739452 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.739590 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.739726 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.739855 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.740008 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.740151 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.740339 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.740501 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.740674 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.740814 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.741008 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.741148 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.741316 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.741450 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.741630 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.741769 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.741940 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.742074 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.742251 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.742393 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.742559 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.742700 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.742870 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.743056 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.743339 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.743570 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.743756 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.743892 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.744020 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.744162 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.744292 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.744491 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.744624 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.744764 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.744900 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.745039 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.745167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.745303 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.745475 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.745616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.745785 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.745927 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.746093 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.746225 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.746399 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.746537 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.746709 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.746841 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.747020 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.747160 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.747340 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.747554 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.747698 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.747833 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.748044 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.748184 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.748312 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.748461 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.748609 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.748785 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.748932 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.749140 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.749279 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.749422 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.749558 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.749714 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.749855 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.750040 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.750182 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.750368 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.750503 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.750679 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.750818 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.750985 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.751118 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.751291 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.751432 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.751601 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.751733 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.751905 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.752037 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.752208 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.752349 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.752536 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.752670 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.752840 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.752981 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.753142 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.753276 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.753463 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.753595 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.753771 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.753914 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.754073 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.754206 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.754375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.754507 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.754677 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.754823 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.755020 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.755161 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.755325 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.755458 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.755668 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.755813 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.756005 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.756146 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.756321 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.756483 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.756668 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.756802 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.756978 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.757117 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.757291 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.757423 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.757739 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.757883 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.758036 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.758233 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.758372 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.758509 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.759174 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.759493 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.759713 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.759864 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.760002 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.760166 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.760166 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.760497 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.760637 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.760766 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.760900 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.761034 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.761176 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.761313 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.761442 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.761576 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.761712 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.761848 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.761977 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.762111 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.762240 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.762375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.762503 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.762644 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.762773 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.762914 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.763043 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.763179 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.763308 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.763445 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.763574 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.763760 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.763901 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.764072 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.764203 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.764384 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.764549 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.764722 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.764863 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.765036 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.765250 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.765382 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.765511 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.765646 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.765782 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.765957 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.766104 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.766270 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.766402 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.766594 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.766725 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.766905 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.767047 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.767226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.767366 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.767537 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.767678 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.767857 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.768012 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.768188 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.768472 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.768609 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.768752 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.768895 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.769033 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.769162 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.769290 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.769438 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.769647 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.769795 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.769926 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.770054 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.770189 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.770326 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.770455 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.770629 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.770764 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.770935 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.771070 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.771246 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.771389 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.771554 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.771687 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.771862 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.772003 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.772166 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.772317 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.772477 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.772607 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.772796 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.772939 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.773105 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.773248 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.773414 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.773555 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.773720 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.773862 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.774029 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.774175 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.774926 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.775149 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.775364 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.775581 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.775719 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.775867 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.775999 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.776134 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.776262 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.776389 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.776564 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.776701 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.776842 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.777037 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.777176 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.777311 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.777454 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.777591 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.777720 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.777848 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.778019 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.778144 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.778338 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.778444 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.778657 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.778778 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.779010 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.779199 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.779317 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.779530 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.779634 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.779851 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.779962 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.780168 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.780283 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.780512 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.780630 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.780831 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.780927 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.781150 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.781247 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.781467 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.781564 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.781779 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.781884 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.782089 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.782193 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.782400 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.782496 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.782708 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.782810 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.783019 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.783116 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.783344 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.783439 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.783655 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.783764 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.783967 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.784075 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.784281 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.784469 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.784603 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.784746 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.784912 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.785053 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.785234 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.785369 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.785571 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.785802 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.785942 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.786136 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.786276 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.786511 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.786652 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.787124 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.787263 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.787441 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.787574 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.787755 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.787901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.788072 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.788286 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.788438 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.788742 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.788880 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.789016 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.789152 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.789287 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.789423 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.789551 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.789684 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.790024 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.790237 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.790465 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.790465 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.790766 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.790903 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.791032 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.791168 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.791304 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.791442 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.791571 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.791699 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.791833 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.791960 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.792101 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.792228 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.792356 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.792565 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.792700 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.792916 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.793057 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.793224 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.793355 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.793536 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.793673 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.793843 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.794050 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.794189 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.794431 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.794563 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.794755 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.794895 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.795060 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.795212 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.795428 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.795567 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.795869 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.796194 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.796596 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.796929 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.797272 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.797705 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.798045 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.798176 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.798407 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.798953 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.799305 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.799729 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.800110 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.800533 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.800743 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.800876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.801116 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.801259 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.801477 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.801618 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.801786 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.801918 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.802098 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.802239 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.802421 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.802552 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.802739 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.802870 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.803049 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.803190 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.803358 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.803489 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.803704 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.803840 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.804018 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.804157 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.804326 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.804498 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.804664 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.804795 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.804971 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.805117 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.805330 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.805463 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.805686 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.805907 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.806140 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.806313 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.806454 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.806584 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.806719 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.806855 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.806994 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.807123 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.807251 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.807370 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.807504 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.807683 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.807825 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.807993 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.808132 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.808302 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.808507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.808650 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.808948 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.809090 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.809226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.809355 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.809485 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.809622 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.809752 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.809887 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.810012 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.810148 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.810284 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.810521 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.810655 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.810782 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.810907 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.811040 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.811182 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.811317 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.811452 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.811587 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.811721 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.811889 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.812034 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.812212 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.812352 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.812548 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.812693 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.812853 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.812994 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.813160 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.813291 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.813473 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.813777 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.813918 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.814079 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.814211 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.814392 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.814523 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.814715 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.814856 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.815033 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.815172 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.815338 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.815477 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.815650 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.815792 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.815953 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.816085 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.816257 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.816390 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.816587 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.816733 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.816900 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.817031 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.817203 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.817343 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.817507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.817653 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.817812 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.817944 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.818116 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.818246 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.818449 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.818579 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.818713 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.818855 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.819135 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.819275 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.819413 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.819550 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.819678 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.819812 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.819948 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.820087 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.820228 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.820363 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.820543 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.820762 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.820894 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.821031 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.821672 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.821914 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.822147 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.822306 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.822444 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.822587 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.822716 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.822844 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.822970 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.823098 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.823225 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.823366 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.823501 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.823630 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.823766 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.823894 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.824070 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.824253 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.824411 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.824543 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.824701 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.824835 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.825004 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.825138 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.825326 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.825458 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.825635 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.825774 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.825944 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.826077 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.826265 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.826404 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.826588 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.826729 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.826913 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.827045 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.827219 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.827359 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.827529 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.827667 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.827839 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.827970 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.828146 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.828286 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.828479 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.828627 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.828797 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.828929 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.829113 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.829243 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.829429 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.829553 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.829742 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.829858 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.830054 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.830159 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.830364 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.830480 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.830671 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.830778 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.830981 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.831093 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.831291 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.831394 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.831595 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.831706 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.831896 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.831998 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.832208 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.832313 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.832537 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.832643 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.832842 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.832937 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.833146 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.833243 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.833449 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.833543 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.833749 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.833843 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.834052 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.834177 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.834359 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.834663 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.834776 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.834973 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.835081 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.835306 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.835405 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.835581 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.835675 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.835898 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.835997 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.836193 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.836323 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.836526 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.836626 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.837419 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.837654 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.837753 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.838024 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.838121 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.838360 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.838468 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.838696 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.838804 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.839018 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.839115 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.839322 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.839408 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.839630 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.839724 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.839944 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.840038 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.840253 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.840336 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.840592 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.840680 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.841686 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.841788 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.841881 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.841966 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.842048 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.842130 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.842218 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.842316 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.842414 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.842510 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.842598 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.842742 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.842915 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.843073 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.843221 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.843357 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.843488 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.843651 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.843810 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.843979 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.844123 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.844306 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.844484 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.844642 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.844787 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.844974 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.845101 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.845297 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.845430 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.845620 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.845762 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.845942 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.846077 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.846256 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.846388 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.846587 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.846733 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.846901 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.847040 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.847215 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.847349 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.847528 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.847668 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.847836 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.847969 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.848147 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.848278 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.848494 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.848695 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.848837 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.848974 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.849107 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.849236 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.849446 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.849578 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.849761 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.849900 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.850092 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.850232 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.850424 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.850564 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.850905 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.851050 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.851188 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.851333 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.851558 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.851693 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.851822 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.851950 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.852078 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.852207 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.852348 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.852609 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.852786 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.853000 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.853208 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 08 02:04:37.853448 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.853448 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.853745 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.854058 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.854366 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.854672 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.854996 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.855301 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.855626 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.855943 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.856267 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.856614 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.856922 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.857245 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.857555 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.857877 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.858167 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.858471 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.858816 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.859123 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.859443 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.859773 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.860100 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.860485 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.860767 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.861102 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.861415 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.861737 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.862060 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.862363 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.862667 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.862978 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.863442 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.863811 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.864779 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.865149 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.865604 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.866320 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.866576 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.866937 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.867457 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.867617 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.868556 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.869477 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.869808 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.870117 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.870675 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.871001 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.871568 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.871673 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.872022 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.872382 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.873286 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.873701 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.874661 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.875070 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.875548 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.876022 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.876530 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.876930 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.877365 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.877753 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.878147 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.878534 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.878925 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.879551 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.879947 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.880338 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.880750 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.881133 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.881592 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.882050 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.882506 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.882970 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.883424 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.887812 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.888690 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.889056 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.889414 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.889838 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.890123 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.890454 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.890783 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.891112 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.891481 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.891805 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.892117 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.892460 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.892790 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.893108 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.893425 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.893739 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.894055 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.894370 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.894684 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.894997 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.895312 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.895628 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.895953 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.896287 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.896636 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.896953 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.897267 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.897584 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.898144 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.898475 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.898826 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.899144 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.899842 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.900166 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.900509 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.900842 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.901151 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.901458 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.901769 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.902077 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.902383 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.902714 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.903486 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.903797 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.904121 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.904453 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.905011 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.905365 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.905686 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.906030 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.906360 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.906697 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.907005 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.907318 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.907638 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.908434 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.908757 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.909071 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.909379 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.909686 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.910003 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.910341 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.910635 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.910972 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.911276 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.911609 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.912191 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.912530 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.912837 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.913148 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.915051 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.915051 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.915051 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.915051 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.915051 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.915954 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO dbcounter [None req-ac3b9033-8ec6-44c0-bc13-7c8a6af6d643 None None] Registered counter for database nova_api Jun 08 02:04:37.916048 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.916219 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.916584 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.916918 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.917229 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.917550 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.917913 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.918242 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.918569 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.918894 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.919215 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.919526 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.919849 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.920164 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.920608 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.920852 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.921168 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.921736 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.922072 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.922397 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.922738 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.925382 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.925717 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.926174 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.926495 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.926832 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.927154 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.927472 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.927787 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.928104 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.928468 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.928777 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.929092 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.929406 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.929718 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.930030 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.932541 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.932892 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.933225 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.933560 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.933922 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.934256 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.934581 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.934907 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.935230 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.935546 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.935863 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.935963 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_db.sqlalchemy.engines [None req-ac3b9033-8ec6-44c0-bc13-7c8a6af6d643 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117938) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 02:04:37.936177 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.936535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.936857 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.937190 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.937508 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.937817 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.938248 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.938568 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.938888 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.939209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.939522 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.939846 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.940366 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.940700 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.941026 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.941339 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.941687 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.942036 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.942367 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.942637 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writer thread running {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 02:04:37.942761 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.943035 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.943278 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.943634 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.943949 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.944270 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.944603 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.944908 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.946902 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.946902 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.946902 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.946902 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.947414 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.947936 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.948254 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.948595 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.948906 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.949216 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.949522 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.949972 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.950119 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.950433 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.950735 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.951038 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.951342 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.951645 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.951945 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.952409 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.952756 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.953072 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.953394 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.953704 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.954023 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.954330 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.954651 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.954969 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.955285 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.955592 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.955924 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.956234 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.956567 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.956879 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.957188 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.957494 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.957800 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.958125 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.958448 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.958753 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.959076 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.959394 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.959709 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.960024 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.960331 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.960683 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.960992 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.961300 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.961616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.962549 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.962876 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.963197 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.963518 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.963847 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.964175 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.964512 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.964838 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.965165 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.965513 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.965857 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.966167 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.966492 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.966805 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.967125 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.967447 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 02:04:37.967659 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 08 02:04:38.002819 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.context [None req-ac3b9033-8ec6-44c0-bc13-7c8a6af6d643 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),876846fb-da6a-4e76-ba4b-88f12695565c(cell1) {{(pid=117938) load_cells /opt/stack/nova/nova/context.py:464}} Jun 08 02:04:38.007067 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ac3b9033-8ec6-44c0-bc13-7c8a6af6d643 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:04:38.009322 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ac3b9033-8ec6-44c0-bc13-7c8a6af6d643 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:04:38.010317 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ac3b9033-8ec6-44c0-bc13-7c8a6af6d643 None None] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:04:38.012835 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ac3b9033-8ec6-44c0-bc13-7c8a6af6d643 None None] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:04:38.014329 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO dbcounter [None req-ac3b9033-8ec6-44c0-bc13-7c8a6af6d643 None None] Registered counter for database nova_cell0 Jun 08 02:04:38.019801 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO dbcounter [None req-ac3b9033-8ec6-44c0-bc13-7c8a6af6d643 None None] Registered counter for database nova_cell1 Jun 08 02:04:38.029771 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_db.sqlalchemy.engines [None req-ac3b9033-8ec6-44c0-bc13-7c8a6af6d643 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117938) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 02:04:38.030574 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_db.sqlalchemy.engines [None req-ac3b9033-8ec6-44c0-bc13-7c8a6af6d643 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117938) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 02:04:38.033077 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO dbcounter [None req-2c862aa1-5e33-43c5-a409-2b8987a31f31 None None] Registered counter for database nova_api Jun 08 02:04:38.038031 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writer thread running {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 02:04:38.039461 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writer thread running {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 02:04:38.053769 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_db.sqlalchemy.engines [None req-2c862aa1-5e33-43c5-a409-2b8987a31f31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117939) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 02:04:38.061710 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writer thread running {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 02:04:38.120671 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.context [None req-2c862aa1-5e33-43c5-a409-2b8987a31f31 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),876846fb-da6a-4e76-ba4b-88f12695565c(cell1) {{(pid=117939) load_cells /opt/stack/nova/nova/context.py:464}} Jun 08 02:04:38.125090 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2c862aa1-5e33-43c5-a409-2b8987a31f31 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:04:38.126822 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2c862aa1-5e33-43c5-a409-2b8987a31f31 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:04:38.127736 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2c862aa1-5e33-43c5-a409-2b8987a31f31 None None] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:04:38.129854 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2c862aa1-5e33-43c5-a409-2b8987a31f31 None None] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:04:38.132002 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO dbcounter [None req-2c862aa1-5e33-43c5-a409-2b8987a31f31 None None] Registered counter for database nova_cell0 Jun 08 02:04:38.138140 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO dbcounter [None req-2c862aa1-5e33-43c5-a409-2b8987a31f31 None None] Registered counter for database nova_cell1 Jun 08 02:04:38.145743 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_db.sqlalchemy.engines [None req-2c862aa1-5e33-43c5-a409-2b8987a31f31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117939) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 02:04:38.147495 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_db.sqlalchemy.engines [None req-2c862aa1-5e33-43c5-a409-2b8987a31f31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117939) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 02:04:38.156618 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writer thread running {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 02:04:38.157882 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writer thread running {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 02:04:38.189385 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO dbcounter [None req-ac3b9033-8ec6-44c0-bc13-7c8a6af6d643 None None] Registered counter for database nova_cell0 Jun 08 02:04:38.196024 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_db.sqlalchemy.engines [None req-ac3b9033-8ec6-44c0-bc13-7c8a6af6d643 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117938) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 02:04:38.200905 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writer thread running {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 02:04:38.312562 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO dbcounter [None req-2c862aa1-5e33-43c5-a409-2b8987a31f31 None None] Registered counter for database nova_cell0 Jun 08 02:04:38.323296 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_db.sqlalchemy.engines [None req-2c862aa1-5e33-43c5-a409-2b8987a31f31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117939) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 02:04:38.329641 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writer thread running {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 02:04:38.646165 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: WARNING keystonemiddleware.auth_token [None req-ac3b9033-8ec6-44c0-bc13-7c8a6af6d643 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 08 02:04:38.654420 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: WARNING keystonemiddleware.auth_token [None req-ac3b9033-8ec6-44c0-bc13-7c8a6af6d643 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 08 02:04:38.771921 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: WARNING keystonemiddleware.auth_token [None req-2c862aa1-5e33-43c5-a409-2b8987a31f31 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 08 02:04:38.779778 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: WARNING keystonemiddleware.auth_token [None req-2c862aa1-5e33-43c5-a409-2b8987a31f31 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 08 02:04:38.881828 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: WARNING keystonemiddleware.auth_token [None req-ac3b9033-8ec6-44c0-bc13-7c8a6af6d643 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 08 02:04:38.887915 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: WARNING keystonemiddleware.auth_token [None req-ac3b9033-8ec6-44c0-bc13-7c8a6af6d643 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 08 02:04:38.893003 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55de0507e9c0 pid: 117938 (default app) Jun 08 02:04:39.009810 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: WARNING keystonemiddleware.auth_token [None req-2c862aa1-5e33-43c5-a409-2b8987a31f31 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 08 02:04:39.015855 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: WARNING keystonemiddleware.auth_token [None req-2c862aa1-5e33-43c5-a409-2b8987a31f31 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 08 02:04:39.020968 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55de0507e9c0 pid: 117939 (default app) Jun 08 02:05:19.403169 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=3 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:05:19.404547 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=3 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:05:19.406060 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=3 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:05:19.407239 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=3 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:05:20.607274 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b8be1178-ba67-46fb-80e0-bd21f495fac0 tempest-VolumesGetTestJSON-547220995 tempest-VolumesGetTestJSON-547220995-project] Action: 'create', calling method: .version_select at 0x7f8370ede5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2086197147", "metadata": {"Type": "work"}}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:05:21.031049 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=3 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:05:21.033345 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=3 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:05:21.034841 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=3 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:05:21.036909 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=3 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:05:22.630803 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b8be1178-ba67-46fb-80e0-bd21f495fac0 tempest-VolumesGetTestJSON-547220995 tempest-VolumesGetTestJSON-547220995-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.239294 Jun 08 02:05:22.631460 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1155 bytes} [Wed Jun 8 02:05:19 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3242 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 08 02:05:22.782153 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2e218bb9-fc98-4cd9-9436-bb4f2400f220 tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] Action: 'create', calling method: .version_select at 0x7f8370ede5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2099982366"}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:05:23.167262 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cc7b3f37-36d4-4160-b27c-fdb8069fb7b0 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1912462610", "imageRef": "e648e482-e374-429d-8152-a4a63797f314", "flavorRef": "452", "networks": [{"uuid": "5af62f32-1fcc-4a27-85e9-df350119e5e8"}]}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:05:23.365140 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.network.neutron [None req-cc7b3f37-36d4-4160-b27c-fdb8069fb7b0 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] validate_networks() for [('5af62f32-1fcc-4a27-85e9-df350119e5e8', None, None, None, None, None)] {{(pid=117938) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 02:05:24.334897 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2e218bb9-fc98-4cd9-9436-bb4f2400f220 tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.313846 Jun 08 02:05:24.335866 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 1/2] 10.222.0.20 () {60 vars in 1154 bytes} [Wed Jun 8 02:05:21 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3317 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 08 02:05:24.343565 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-50c47354-3f39-4468-a460-5d3d748973aa tempest-VolumesGetTestJSON-547220995 tempest-VolumesGetTestJSON-547220995-project] Calling method '.version_select at 0x7f8370da75e0>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:24.487107 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-50c47354-3f39-4468-a460-5d3d748973aa tempest-VolumesGetTestJSON-547220995 tempest-VolumesGetTestJSON-547220995-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/521b60a4-0165-4714-bfbe-de40b4d933d4" status: 200 len: 354 microversion: 2.1 time: 0.149836 Jun 08 02:05:24.487670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jun 8 02:05:24 2022] GET /compute/v2.1/os-volumes/521b60a4-0165-4714-bfbe-de40b4d933d4 => generated 354 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:05:24.495153 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-76c07982-cb73-4143-adc9-f376d228a0e4 tempest-VolumesTestJSON-599525569 tempest-VolumesTestJSON-599525569-project] Calling method '.version_select at 0x7f8370da7670>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:24.565322 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-76c07982-cb73-4143-adc9-f376d228a0e4 tempest-VolumesTestJSON-599525569 tempest-VolumesTestJSON-599525569-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/690db81f-7240-4155-97f2-82dd243838d2" status: 200 len: 350 microversion: 2.1 time: 0.076500 Jun 08 02:05:24.566405 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 3/4] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jun 8 02:05:24 2022] GET /compute/v2.1/os-volumes/690db81f-7240-4155-97f2-82dd243838d2 => generated 350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:05:24.571452 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-3b99ac58-caf6-4a23-a8a3-8053053425b0 tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] Calling method '.version_select at 0x7f8370da7e50>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:24.715486 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-cc7b3f37-36d4-4160-b27c-fdb8069fb7b0 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Flavor limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 02:05:24.716227 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-cc7b3f37-36d4-4160-b27c-fdb8069fb7b0 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Image limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 02:05:24.716906 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-cc7b3f37-36d4-4160-b27c-fdb8069fb7b0 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Flavor pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 02:05:24.717750 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-cc7b3f37-36d4-4160-b27c-fdb8069fb7b0 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Image pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 02:05:24.718656 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-cc7b3f37-36d4-4160-b27c-fdb8069fb7b0 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 02:05:24.747842 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-3b99ac58-caf6-4a23-a8a3-8053053425b0 tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/8acd9961-20cd-4a62-81bd-f421e46b0c98" status: 200 len: 346 microversion: 2.1 time: 0.179525 Jun 08 02:05:24.748621 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 4/5] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jun 8 02:05:24 2022] GET /compute/v2.1/os-volumes/8acd9961-20cd-4a62-81bd-f421e46b0c98 => generated 346 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:05:24.755264 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-cf9d7781-779a-416b-ba8f-df3c68be96fc tempest-VolumesGetTestJSON-547220995 tempest-VolumesGetTestJSON-547220995-project] Calling method '.version_select at 0x7f8370dba550>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:24.800546 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cc7b3f37-36d4-4160-b27c-fdb8069fb7b0 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:24.804168 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cc7b3f37-36d4-4160-b27c-fdb8069fb7b0 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:24.815349 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cc7b3f37-36d4-4160-b27c-fdb8069fb7b0 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:24.817505 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cc7b3f37-36d4-4160-b27c-fdb8069fb7b0 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:24.894384 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-cc7b3f37-36d4-4160-b27c-fdb8069fb7b0 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Getting quotas for project 16b90d01b80e450b9357d02c245c9531. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 02:05:24.906988 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-cf9d7781-779a-416b-ba8f-df3c68be96fc tempest-VolumesGetTestJSON-547220995 tempest-VolumesGetTestJSON-547220995-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/521b60a4-0165-4714-bfbe-de40b4d933d4" status: 200 len: 354 microversion: 2.1 time: 0.156547 Jun 08 02:05:24.919375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 5/6] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jun 8 02:05:24 2022] GET /compute/v2.1/os-volumes/521b60a4-0165-4714-bfbe-de40b4d933d4 => generated 354 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:05:24.919375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-398270e7-a8e5-4daa-aa44-566a9e094d9e tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] Action: 'create', calling method: .version_select at 0x7f8370da7d30>, body: {"snapshot": {"volume_id": "8acd9961-20cd-4a62-81bd-f421e46b0c98", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-840282929"}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:05:24.927715 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-cc7b3f37-36d4-4160-b27c-fdb8069fb7b0 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Getting quotas for user 71ee50293b204bedb1ea03d77b940514 and project 16b90d01b80e450b9357d02c245c9531. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 02:05:24.955433 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-cc7b3f37-36d4-4160-b27c-fdb8069fb7b0 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Going to run 1 instances... {{(pid=117938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 02:05:24.958710 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-cc7b3f37-36d4-4160-b27c-fdb8069fb7b0 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e648e482-e374-429d-8152-a4a63797f314',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 02:05:25.106767 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-cc7b3f37-36d4-4160-b27c-fdb8069fb7b0 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.468953 Jun 08 02:05:25.109839 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 2/7] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jun 8 02:05:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2478 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 08 02:05:25.124100 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-938db8aa-4b2e-4ee1-9662-3ce9028ae692 tempest-VolumesGetTestJSON-547220995 tempest-VolumesGetTestJSON-547220995-project] Calling method '.version_select at 0x7f8370cc0700>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:25.345507 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-938db8aa-4b2e-4ee1-9662-3ce9028ae692 tempest-VolumesGetTestJSON-547220995 tempest-VolumesGetTestJSON-547220995-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/521b60a4-0165-4714-bfbe-de40b4d933d4" status: 202 len: 0 microversion: 2.1 time: 0.233854 Jun 08 02:05:25.347112 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 3/8] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Jun 8 02:05:25 2022] DELETE /compute/v2.1/os-volumes/521b60a4-0165-4714-bfbe-de40b4d933d4 => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 02:05:25.356130 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-dbcb82fc-b4b5-4fd2-9fa6-55eabbad5a44 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:25.357245 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-dbcb82fc-b4b5-4fd2-9fa6-55eabbad5a44 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:25.453129 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-398270e7-a8e5-4daa-aa44-566a9e094d9e tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.543614 Jun 08 02:05:25.453838 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 6/9] 10.222.0.20 () {60 vars in 1161 bytes} [Wed Jun 8 02:05:24 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:05:25.463939 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a5ae01b6-fcf2-4009-82ca-b4682b8dfa26 tempest-VolumesGetTestJSON-547220995 tempest-VolumesGetTestJSON-547220995-project] Calling method '.version_select at 0x7f8370dba670>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:25.597750 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a5ae01b6-fcf2-4009-82ca-b4682b8dfa26 tempest-VolumesGetTestJSON-547220995 tempest-VolumesGetTestJSON-547220995-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/521b60a4-0165-4714-bfbe-de40b4d933d4" status: 200 len: 353 microversion: 2.1 time: 0.142575 Jun 08 02:05:25.599103 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 7/10] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jun 8 02:05:25 2022] GET /compute/v2.1/os-volumes/521b60a4-0165-4714-bfbe-de40b4d933d4 => generated 353 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:05:25.611294 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d46e335c-5e0f-4c0a-9b93-b3fcc0107359 tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] Calling method '.version_select at 0x7f8370dba040>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:25.718329 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d46e335c-5e0f-4c0a-9b93-b3fcc0107359 tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/d18fb0ea-7345-4cf8-bfe3-4d8f730f335b" status: 200 len: 286 microversion: 2.1 time: 0.117477 Jun 08 02:05:25.719385 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 8/11] 10.222.0.20 () {58 vars in 1250 bytes} [Wed Jun 8 02:05:25 2022] GET /compute/v2.1/os-snapshots/d18fb0ea-7345-4cf8-bfe3-4d8f730f335b => generated 286 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:05:25.729809 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-3ab23b76-442a-479f-bead-3d4e8d7929d3 tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] Calling method '.version_select at 0x7f8370da7790>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:25.778563 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-dbcb82fc-b4b5-4fd2-9fa6-55eabbad5a44 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee50293b204bedb1ea03d77b940514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b90d01b80e450b9357d02c245c9531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:25.830994 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-dbcb82fc-b4b5-4fd2-9fa6-55eabbad5a44 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475" status: 200 len: 1215 microversion: 2.1 time: 0.481463 Jun 08 02:05:25.836805 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 4/12] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:25 2022] GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 => generated 1215 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:05:25.862299 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-3ab23b76-442a-479f-bead-3d4e8d7929d3 tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.136868 Jun 08 02:05:25.863057 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 9/13] 10.222.0.20 () {58 vars in 1139 bytes} [Wed Jun 8 02:05:25 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 02:05:25.876277 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4a4ce43e-0069-40cc-ba48-971d8214da07 tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] Calling method '.version_select at 0x7f8370cc0ee0>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:25.989397 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4a4ce43e-0069-40cc-ba48-971d8214da07 tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/d18fb0ea-7345-4cf8-bfe3-4d8f730f335b" status: 200 len: 286 microversion: 2.1 time: 0.118739 Jun 08 02:05:25.990415 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 5/14] 10.222.0.20 () {58 vars in 1250 bytes} [Wed Jun 8 02:05:25 2022] GET /compute/v2.1/os-snapshots/d18fb0ea-7345-4cf8-bfe3-4d8f730f335b => generated 286 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:05:26.166524 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0fa392fc-989b-4445-90db-7c7be7df9227 tempest-VolumesTestJSON-599525569 tempest-VolumesTestJSON-599525569-project] Calling method '.version_select at 0x7f8370dbad30>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:26.283821 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-0fa392fc-989b-4445-90db-7c7be7df9227 tempest-VolumesTestJSON-599525569 tempest-VolumesTestJSON-599525569-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/47d8c6ba-c36e-4751-a4f2-83c5bf54cb54" status: 200 len: 350 microversion: 2.1 time: 0.127640 Jun 08 02:05:26.286987 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 10/15] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jun 8 02:05:26 2022] GET /compute/v2.1/os-volumes/47d8c6ba-c36e-4751-a4f2-83c5bf54cb54 => generated 350 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:05:26.612381 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-53498864-fefa-44ec-a16b-8226c7ceec96 tempest-VolumesGetTestJSON-547220995 tempest-VolumesGetTestJSON-547220995-project] Calling method '.version_select at 0x7f83704718b0>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:26.860171 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-bc1480c5-35ae-4b5d-aa93-4ce382614baa tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:26.862472 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-bc1480c5-35ae-4b5d-aa93-4ce382614baa tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:26.900017 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-53498864-fefa-44ec-a16b-8226c7ceec96 tempest-VolumesGetTestJSON-547220995 tempest-VolumesGetTestJSON-547220995-project] HTTP exception thrown: Volume 521b60a4-0165-4714-bfbe-de40b4d933d4 could not be found. Jun 08 02:05:26.910367 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-53498864-fefa-44ec-a16b-8226c7ceec96 tempest-VolumesGetTestJSON-547220995 tempest-VolumesGetTestJSON-547220995-project] Request method failure captured: Jun 08 02:05:26.910367 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/os-volumes/521b60a4-0165-4714-bfbe-de40b4d933d4 HTTP/1.1 Jun 08 02:05:26.910367 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept: application/json Jun 08 02:05:26.910367 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jun 08 02:05:26.910367 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Connection: close Jun 08 02:05:26.910367 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jun 08 02:05:26.910367 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jun 08 02:05:26.910367 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Host: 10.222.0.20 Jun 08 02:05:26.910367 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jun 08 02:05:26.910367 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jun 08 02:05:26.910367 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABioAPfs4y97hDoL22wHIZgYTELkaxrAX9Rh5lYoqKYpcotxNlYnmEn31NqVYTTlAwDc7y6oV0FjxTlfRD4q-3nWV1-LB_7zKESh1Ebsd_SZ8WjcB3Vj1DkGLHM0M4KPdP5l-mEYwdigOfUsppEZ5wOcoEJZTdYD9RiEAFU4SypTVFD9Y4 Jun 08 02:05:26.910367 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jun 08 02:05:26.910367 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jun 08 02:05:26.910367 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jun 08 02:05:26.910367 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jun 08 02:05:26.910367 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jun 08 02:05:26.910367 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jun 08 02:05:26.910367 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Id: c1f3f7571cb24d069d7bb1182bafb300 Jun 08 02:05:26.910367 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-VolumesGetTestJSON-547220995 Jun 08 02:05:26.910367 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jun 08 02:05:26.910367 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jun 08 02:05:26.911659 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c1f3f7571cb24d069d7bb1182bafb300"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c1f3f7571cb24d069d7bb1182bafb300", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c1f3f7571cb24d069d7bb1182bafb300"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c1f3f7571cb24d069d7bb1182bafb300"}]}] Jun 08 02:05:26.911659 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-VolumesGetTestJSON-547220995 Jun 08 02:05:26.911659 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Id: c1f3f7571cb24d069d7bb1182bafb300 Jun 08 02:05:26.911659 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-VolumesGetTestJSON-547220995 Jun 08 02:05:26.911659 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User: tempest-VolumesGetTestJSON-547220995-project Jun 08 02:05:26.911659 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jun 08 02:05:26.911659 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jun 08 02:05:26.911659 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Id: fdf621d5692b4fe9995b026819e71f92 Jun 08 02:05:26.911659 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-VolumesGetTestJSON-547220995-project Jun 08 02:05:26.911659 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: method: Jun 08 02:05:26.911659 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: exception: Volume 521b60a4-0165-4714-bfbe-de40b4d933d4 could not be found. Jun 08 02:05:26.911659 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: action_args: {'id': '521b60a4-0165-4714-bfbe-de40b4d933d4'} Jun 08 02:05:26.911659 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:05:26.912291 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:26.912291 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 08 02:05:26.912291 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 08 02:05:26.912291 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 08 02:05:26.912291 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 08 02:05:26.912291 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 08 02:05:26.912291 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 08 02:05:26.912291 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 08 02:05:26.912291 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 08 02:05:26.912291 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 08 02:05:26.912291 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 08 02:05:26.912291 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 08 02:05:26.912291 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 08 02:05:26.912291 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 08 02:05:26.912291 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 08 02:05:26.912291 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 521b60a4-0165-4714-bfbe-de40b4d933d4 could not be found. (HTTP 404) (Request-ID: req-877c0004-ab6a-4f7a-9452-00727d4c2a52) Jun 08 02:05:26.912291 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:05:26.912291 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:05:26.912291 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:05:26.913821 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:26.913821 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 08 02:05:26.913821 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 08 02:05:26.913821 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 08 02:05:26.913821 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 08 02:05:26.913821 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 08 02:05:26.913821 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 08 02:05:26.913821 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 08 02:05:26.913821 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 08 02:05:26.913821 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 08 02:05:26.913821 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 08 02:05:26.913821 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 08 02:05:26.913821 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 08 02:05:26.913821 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 08 02:05:26.913821 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 08 02:05:26.913821 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 08 02:05:26.913821 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 08 02:05:26.913821 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 08 02:05:26.913821 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 08 02:05:26.914840 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 08 02:05:26.914840 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 08 02:05:26.914840 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 08 02:05:26.914840 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 08 02:05:26.914840 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 521b60a4-0165-4714-bfbe-de40b4d933d4 could not be found. Jun 08 02:05:26.914840 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:05:26.914840 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:05:26.914840 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:05:26.914840 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:26.914840 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:05:26.914840 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:05:26.914840 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:05:26.914840 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:05:26.914840 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 08 02:05:26.914840 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 08 02:05:26.914840 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:05:26.914840 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:05:26.914840 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 08 02:05:26.914840 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:05:26.915660 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 521b60a4-0165-4714-bfbe-de40b4d933d4 could not be found. Jun 08 02:05:26.915660 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:05:26.915660 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:05:26.915660 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:05:26.915660 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:26.915660 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:05:26.915660 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:05:26.915660 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:05:26.915660 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:05:26.915660 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 521b60a4-0165-4714-bfbe-de40b4d933d4 could not be found. Jun 08 02:05:26.915660 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:05:26.915660 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-53498864-fefa-44ec-a16b-8226c7ceec96 tempest-VolumesGetTestJSON-547220995 tempest-VolumesGetTestJSON-547220995-project] Returning 404 to user: Volume 521b60a4-0165-4714-bfbe-de40b4d933d4 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:05:26.915660 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-53498864-fefa-44ec-a16b-8226c7ceec96 tempest-VolumesGetTestJSON-547220995 tempest-VolumesGetTestJSON-547220995-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/521b60a4-0165-4714-bfbe-de40b4d933d4" status: 404 len: 109 microversion: 2.1 time: 0.305055 Jun 08 02:05:26.921376 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 6/16] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jun 8 02:05:26 2022] GET /compute/v2.1/os-volumes/521b60a4-0165-4714-bfbe-de40b4d933d4 => generated 109 bytes in 315 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 02:05:27.002573 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0c6dd3cf-b061-41da-b6d0-330cccf48867 tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] Calling method '.version_select at 0x7f837044b8b0>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:27.215041 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0c6dd3cf-b061-41da-b6d0-330cccf48867 tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/d18fb0ea-7345-4cf8-bfe3-4d8f730f335b" status: 200 len: 286 microversion: 2.1 time: 0.216463 Jun 08 02:05:27.215779 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 7/17] 10.222.0.20 () {58 vars in 1250 bytes} [Wed Jun 8 02:05:26 2022] GET /compute/v2.1/os-snapshots/d18fb0ea-7345-4cf8-bfe3-4d8f730f335b => generated 286 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 02:05:27.386803 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-bc1480c5-35ae-4b5d-aa93-4ce382614baa tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee50293b204bedb1ea03d77b940514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b90d01b80e450b9357d02c245c9531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:27.446485 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-bc1480c5-35ae-4b5d-aa93-4ce382614baa tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475" status: 200 len: 1215 microversion: 2.1 time: 0.597700 Jun 08 02:05:27.447237 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 11/18] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:26 2022] GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 => generated 1215 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:05:28.229034 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c6e32624-7b33-49f0-9514-83f74cdb2f8b tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] Calling method '.version_select at 0x7f837044b310>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:28.279841 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c6e32624-7b33-49f0-9514-83f74cdb2f8b tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/d18fb0ea-7345-4cf8-bfe3-4d8f730f335b" status: 200 len: 286 microversion: 2.1 time: 0.056464 Jun 08 02:05:28.283830 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 8/19] 10.222.0.20 () {58 vars in 1250 bytes} [Wed Jun 8 02:05:28 2022] GET /compute/v2.1/os-snapshots/d18fb0ea-7345-4cf8-bfe3-4d8f730f335b => generated 286 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:05:28.463535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-3ecf169b-8d08-4621-8416-3530e53c58c9 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:28.464154 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-3ecf169b-8d08-4621-8416-3530e53c58c9 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:28.478573 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3ecf169b-8d08-4621-8416-3530e53c58c9 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:28.479021 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3ecf169b-8d08-4621-8416-3530e53c58c9 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:28.479802 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3ecf169b-8d08-4621-8416-3530e53c58c9 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:28.480235 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3ecf169b-8d08-4621-8416-3530e53c58c9 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:28.877073 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-3ecf169b-8d08-4621-8416-3530e53c58c9 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee50293b204bedb1ea03d77b940514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b90d01b80e450b9357d02c245c9531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:28.914771 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-3ecf169b-8d08-4621-8416-3530e53c58c9 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475" status: 200 len: 1219 microversion: 2.1 time: 0.452762 Jun 08 02:05:28.917097 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 12/20] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:28 2022] GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 => generated 1219 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:05:29.294724 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f6279761-d5c0-40dd-b7ce-70f3c4c22b16 tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] Calling method '.version_select at 0x7f837044baf0>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:29.312865 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-da2915b9-fde4-4b32-a1ab-8b427c1f4732 tempest-VolumesTestJSON-599525569 tempest-VolumesTestJSON-599525569-project] Calling method '.version_select at 0x7f8370d03b80>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:29.375038 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f6279761-d5c0-40dd-b7ce-70f3c4c22b16 tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/d18fb0ea-7345-4cf8-bfe3-4d8f730f335b" status: 200 len: 287 microversion: 2.1 time: 0.086445 Jun 08 02:05:29.375608 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 9/21] 10.222.0.20 () {58 vars in 1250 bytes} [Wed Jun 8 02:05:29 2022] GET /compute/v2.1/os-snapshots/d18fb0ea-7345-4cf8-bfe3-4d8f730f335b => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:05:29.386504 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b1d1e19a-5f81-4a73-b1fd-dfb26070b316 tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] Calling method '.version_select at 0x7f83703e3160>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:29.474742 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-da2915b9-fde4-4b32-a1ab-8b427c1f4732 tempest-VolumesTestJSON-599525569 tempest-VolumesTestJSON-599525569-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/1aea4d72-94ba-4fa5-bd03-09b6db08a2c3" status: 200 len: 351 microversion: 2.1 time: 0.166474 Jun 08 02:05:29.476561 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 13/22] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jun 8 02:05:29 2022] GET /compute/v2.1/os-volumes/1aea4d72-94ba-4fa5-bd03-09b6db08a2c3 => generated 351 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 02:05:29.496759 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-9bff8faf-128c-42eb-80f3-d95e5fac2e89 tempest-VolumesTestJSON-599525569 tempest-VolumesTestJSON-599525569-project] Calling method '.version_select at 0x7f8370d12430>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:29.556126 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b1d1e19a-5f81-4a73-b1fd-dfb26070b316 tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/d18fb0ea-7345-4cf8-bfe3-4d8f730f335b" status: 202 len: 0 microversion: 2.1 time: 0.173220 Jun 08 02:05:29.556942 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 10/23] 10.222.0.20 () {58 vars in 1253 bytes} [Wed Jun 8 02:05:29 2022] DELETE /compute/v2.1/os-snapshots/d18fb0ea-7345-4cf8-bfe3-4d8f730f335b => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 08 02:05:29.572761 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-acf747da-f15e-4db5-b559-d3361492661a tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] Calling method '.version_select at 0x7f837044ba60>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:29.677713 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-acf747da-f15e-4db5-b559-d3361492661a tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/d18fb0ea-7345-4cf8-bfe3-4d8f730f335b" status: 200 len: 286 microversion: 2.1 time: 0.115915 Jun 08 02:05:29.678379 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 11/24] 10.222.0.20 () {58 vars in 1250 bytes} [Wed Jun 8 02:05:29 2022] GET /compute/v2.1/os-snapshots/d18fb0ea-7345-4cf8-bfe3-4d8f730f335b => generated 286 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 02:05:29.744562 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-9bff8faf-128c-42eb-80f3-d95e5fac2e89 tempest-VolumesTestJSON-599525569 tempest-VolumesTestJSON-599525569-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.258174 Jun 08 02:05:29.746023 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 14/25] 10.222.0.20 () {58 vars in 1133 bytes} [Wed Jun 8 02:05:29 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:05:29.759616 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-96037dcd-cbb8-4bb1-8f21-c82320753166 tempest-VolumesTestJSON-599525569 tempest-VolumesTestJSON-599525569-project] Calling method '.version_select at 0x7f837044b4c0>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:29.936226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-338bb8c1-a291-4590-8122-d9075329f78a tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:29.938624 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-338bb8c1-a291-4590-8122-d9075329f78a tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:29.948928 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-96037dcd-cbb8-4bb1-8f21-c82320753166 tempest-VolumesTestJSON-599525569 tempest-VolumesTestJSON-599525569-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.193757 Jun 08 02:05:29.950581 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 12/26] 10.222.0.20 () {58 vars in 1148 bytes} [Wed Jun 8 02:05:29 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:05:29.963389 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-338bb8c1-a291-4590-8122-d9075329f78a tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:29.963852 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-338bb8c1-a291-4590-8122-d9075329f78a tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:29.964685 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-338bb8c1-a291-4590-8122-d9075329f78a tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:29.965128 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-338bb8c1-a291-4590-8122-d9075329f78a tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:29.965775 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-eb0fde79-304c-45f1-b59f-846e8554f3c1 tempest-VolumesTestJSON-599525569 tempest-VolumesTestJSON-599525569-project] Calling method '.version_select at 0x7f83703e30d0>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:30.258153 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-eb0fde79-304c-45f1-b59f-846e8554f3c1 tempest-VolumesTestJSON-599525569 tempest-VolumesTestJSON-599525569-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.299537 Jun 08 02:05:30.259082 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 13/27] 10.222.0.20 () {58 vars in 1133 bytes} [Wed Jun 8 02:05:29 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:05:30.270595 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-65e629a5-2d02-4643-b473-1919975afd0c tempest-VolumesTestJSON-599525569 tempest-VolumesTestJSON-599525569-project] Calling method '.version_select at 0x7f837178d790>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:30.424326 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-338bb8c1-a291-4590-8122-d9075329f78a tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee50293b204bedb1ea03d77b940514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b90d01b80e450b9357d02c245c9531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:30.442423 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-338bb8c1-a291-4590-8122-d9075329f78a tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475" status: 200 len: 1285 microversion: 2.1 time: 0.508025 Jun 08 02:05:30.444446 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 15/28] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:29 2022] GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 => generated 1285 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:05:30.575084 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-65e629a5-2d02-4643-b473-1919975afd0c tempest-VolumesTestJSON-599525569 tempest-VolumesTestJSON-599525569-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.308700 Jun 08 02:05:30.575955 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 14/29] 10.222.0.20 () {58 vars in 1166 bytes} [Wed Jun 8 02:05:30 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 02:05:30.599209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-4a7b96c3-6ae9-4aaf-9b15-0d8939ce5a7d tempest-VolumesTestJSON-599525569 tempest-VolumesTestJSON-599525569-project] Calling method '.version_select at 0x7f8370d03c10>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:30.689716 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-32b0f7d6-f0a1-4a6d-b1d5-fa4be6923e59 tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] Calling method '.version_select at 0x7f837044b670>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:30.734972 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-32b0f7d6-f0a1-4a6d-b1d5-fa4be6923e59 tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] HTTP exception thrown: Snapshot d18fb0ea-7345-4cf8-bfe3-4d8f730f335b could not be found. Jun 08 02:05:30.737294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-32b0f7d6-f0a1-4a6d-b1d5-fa4be6923e59 tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] Request method failure captured: Jun 08 02:05:30.737294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/os-snapshots/d18fb0ea-7345-4cf8-bfe3-4d8f730f335b HTTP/1.1 Jun 08 02:05:30.737294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept: application/json Jun 08 02:05:30.737294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jun 08 02:05:30.737294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Connection: close Jun 08 02:05:30.737294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jun 08 02:05:30.737294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jun 08 02:05:30.737294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Host: 10.222.0.20 Jun 08 02:05:30.737294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jun 08 02:05:30.737294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jun 08 02:05:30.737294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABioAPgs21bXVDUDCEOghgdFrimxm4cU1ObTOQHgKDSJi73LykS8P2oBBvgN8AIEDwXW0PZuq_121c0jL-qlg-8V8yMlenoQCL7B9ohrcuLaIWHEWyDXkbgzidbrrWmZFlZ_xLcxJPynt5uGXa-POwwOjLuuu3RE1PsTC2A1DzytrMJYM0 Jun 08 02:05:30.737294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jun 08 02:05:30.737294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jun 08 02:05:30.737294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jun 08 02:05:30.737294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jun 08 02:05:30.737294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jun 08 02:05:30.737294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jun 08 02:05:30.737294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Id: 8b762d2e87da463dac84eedfdedbeb7f Jun 08 02:05:30.737294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-496295453 Jun 08 02:05:30.737294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jun 08 02:05:30.737294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jun 08 02:05:30.738402 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8b762d2e87da463dac84eedfdedbeb7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8b762d2e87da463dac84eedfdedbeb7f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8b762d2e87da463dac84eedfdedbeb7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8b762d2e87da463dac84eedfdedbeb7f"}]}] Jun 08 02:05:30.738402 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-VolumesSnapshotsTestJSON-496295453 Jun 08 02:05:30.738402 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 8b762d2e87da463dac84eedfdedbeb7f Jun 08 02:05:30.738402 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-496295453 Jun 08 02:05:30.738402 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User: tempest-VolumesSnapshotsTestJSON-496295453-project Jun 08 02:05:30.738402 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jun 08 02:05:30.738402 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jun 08 02:05:30.738402 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Id: 7ae96cbf198740ec94313c7f0a5f6179 Jun 08 02:05:30.738402 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-VolumesSnapshotsTestJSON-496295453-project Jun 08 02:05:30.738402 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: method: Jun 08 02:05:30.738402 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: exception: Snapshot d18fb0ea-7345-4cf8-bfe3-4d8f730f335b could not be found. Jun 08 02:05:30.738402 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: action_args: {'id': 'd18fb0ea-7345-4cf8-bfe3-4d8f730f335b'} Jun 08 02:05:30.738402 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:05:30.739036 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:30.739036 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 08 02:05:30.739036 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 08 02:05:30.739036 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 08 02:05:30.739036 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 08 02:05:30.739036 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 08 02:05:30.739036 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 08 02:05:30.739036 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 08 02:05:30.739036 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 08 02:05:30.739036 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 08 02:05:30.739036 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 08 02:05:30.739036 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 08 02:05:30.739036 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 08 02:05:30.739036 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 08 02:05:30.739036 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 08 02:05:30.739036 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d18fb0ea-7345-4cf8-bfe3-4d8f730f335b could not be found. (HTTP 404) (Request-ID: req-64a10313-a31f-487b-8012-f0398c160a94) Jun 08 02:05:30.739036 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:05:30.739036 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:05:30.739934 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:05:30.739934 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:30.739934 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 08 02:05:30.739934 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 08 02:05:30.739934 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 08 02:05:30.739934 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 08 02:05:30.739934 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 08 02:05:30.739934 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 08 02:05:30.739934 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 08 02:05:30.739934 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 08 02:05:30.739934 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 08 02:05:30.739934 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 08 02:05:30.739934 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 08 02:05:30.739934 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 08 02:05:30.739934 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 08 02:05:30.739934 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 08 02:05:30.739934 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 08 02:05:30.739934 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 08 02:05:30.739934 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 08 02:05:30.742470 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 08 02:05:30.742470 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 08 02:05:30.742470 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 08 02:05:30.742470 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 08 02:05:30.742470 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 08 02:05:30.742470 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d18fb0ea-7345-4cf8-bfe3-4d8f730f335b could not be found. Jun 08 02:05:30.742470 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:05:30.742470 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:05:30.742470 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:05:30.742470 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:30.742470 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:05:30.742470 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:05:30.742470 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:05:30.742470 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:05:30.742470 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 08 02:05:30.742470 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 08 02:05:30.742470 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:05:30.742470 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:05:30.742470 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 08 02:05:30.742470 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:05:30.743406 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d18fb0ea-7345-4cf8-bfe3-4d8f730f335b could not be found. Jun 08 02:05:30.743406 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:05:30.743406 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:05:30.743406 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:05:30.743406 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:30.743406 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:05:30.743406 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:05:30.743406 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:05:30.743406 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:05:30.743406 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d18fb0ea-7345-4cf8-bfe3-4d8f730f335b could not be found. Jun 08 02:05:30.743406 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:05:30.743406 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-32b0f7d6-f0a1-4a6d-b1d5-fa4be6923e59 tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] Returning 404 to user: Snapshot d18fb0ea-7345-4cf8-bfe3-4d8f730f335b could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:05:30.743406 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-32b0f7d6-f0a1-4a6d-b1d5-fa4be6923e59 tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/d18fb0ea-7345-4cf8-bfe3-4d8f730f335b" status: 404 len: 111 microversion: 2.1 time: 0.052751 Jun 08 02:05:30.746104 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 15/30] 10.222.0.20 () {58 vars in 1250 bytes} [Wed Jun 8 02:05:30 2022] GET /compute/v2.1/os-snapshots/d18fb0ea-7345-4cf8-bfe3-4d8f730f335b => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 08 02:05:30.767320 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5e90016e-4abd-417f-b5d9-4fc2f11a7eee tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] Calling method '.version_select at 0x7f837044b940>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:30.852518 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-4a7b96c3-6ae9-4aaf-9b15-0d8939ce5a7d tempest-VolumesTestJSON-599525569 tempest-VolumesTestJSON-599525569-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.264414 Jun 08 02:05:30.864900 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 16/31] 10.222.0.20 () {58 vars in 1169 bytes} [Wed Jun 8 02:05:30 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:05:30.870659 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0a8b3d17-a088-4607-af8e-699bde193d9e tempest-VolumesTestJSON-599525569 tempest-VolumesTestJSON-599525569-project] Calling method '.version_select at 0x7f8370c58430>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:31.022455 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5e90016e-4abd-417f-b5d9-4fc2f11a7eee tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/8acd9961-20cd-4a62-81bd-f421e46b0c98" status: 202 len: 0 microversion: 2.1 time: 0.270156 Jun 08 02:05:31.024073 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 16/32] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Jun 8 02:05:30 2022] DELETE /compute/v2.1/os-volumes/8acd9961-20cd-4a62-81bd-f421e46b0c98 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 02:05:31.034974 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-edd7eb46-ed7b-4233-901c-b55b76861182 tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] Calling method '.version_select at 0x7f837044bee0>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:31.107563 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-0a8b3d17-a088-4607-af8e-699bde193d9e tempest-VolumesTestJSON-599525569 tempest-VolumesTestJSON-599525569-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.240516 Jun 08 02:05:31.115206 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 17/33] 10.222.0.20 () {58 vars in 1154 bytes} [Wed Jun 8 02:05:30 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:05:31.126866 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-bdf58a06-b931-4c56-9505-ff1d06a0dcae tempest-VolumesTestJSON-599525569 tempest-VolumesTestJSON-599525569-project] Calling method '.version_select at 0x7f8370cb93a0>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:31.188189 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-edd7eb46-ed7b-4233-901c-b55b76861182 tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/8acd9961-20cd-4a62-81bd-f421e46b0c98" status: 200 len: 345 microversion: 2.1 time: 0.159787 Jun 08 02:05:31.189688 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 17/34] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jun 8 02:05:31 2022] GET /compute/v2.1/os-volumes/8acd9961-20cd-4a62-81bd-f421e46b0c98 => generated 345 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:05:31.364242 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-bdf58a06-b931-4c56-9505-ff1d06a0dcae tempest-VolumesTestJSON-599525569 tempest-VolumesTestJSON-599525569-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.245569 Jun 08 02:05:31.372661 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 18/35] 10.222.0.20 () {58 vars in 1187 bytes} [Wed Jun 8 02:05:31 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:05:31.379254 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-181d686c-bf94-454a-a17e-d65260fa9359 tempest-VolumesTestJSON-599525569 tempest-VolumesTestJSON-599525569-project] Calling method '.version_select at 0x7f837178d700>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:31.473146 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a5e91b96-5de6-4c7c-8f0a-c6d7228f08e0 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:31.473763 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a5e91b96-5de6-4c7c-8f0a-c6d7228f08e0 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:31.486803 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a5e91b96-5de6-4c7c-8f0a-c6d7228f08e0 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:31.487252 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a5e91b96-5de6-4c7c-8f0a-c6d7228f08e0 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:31.488023 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a5e91b96-5de6-4c7c-8f0a-c6d7228f08e0 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:31.488490 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a5e91b96-5de6-4c7c-8f0a-c6d7228f08e0 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:31.544749 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-181d686c-bf94-454a-a17e-d65260fa9359 tempest-VolumesTestJSON-599525569 tempest-VolumesTestJSON-599525569-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.170473 Jun 08 02:05:31.545312 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 18/36] 10.222.0.20 () {58 vars in 1154 bytes} [Wed Jun 8 02:05:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:05:31.724146 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a5e91b96-5de6-4c7c-8f0a-c6d7228f08e0 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee50293b204bedb1ea03d77b940514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b90d01b80e450b9357d02c245c9531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:31.745819 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a5e91b96-5de6-4c7c-8f0a-c6d7228f08e0 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475" status: 200 len: 1273 microversion: 2.1 time: 0.289716 Jun 08 02:05:31.759043 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 19/37] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:31 2022] GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 => generated 1273 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:05:32.202562 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-cf6e1288-3759-4186-a42f-1706186d2460 tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] Calling method '.version_select at 0x7f8370ca7670>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:32.283283 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-cf6e1288-3759-4186-a42f-1706186d2460 tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] HTTP exception thrown: Volume 8acd9961-20cd-4a62-81bd-f421e46b0c98 could not be found. Jun 08 02:05:32.288530 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-cf6e1288-3759-4186-a42f-1706186d2460 tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] Request method failure captured: Jun 08 02:05:32.288530 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/os-volumes/8acd9961-20cd-4a62-81bd-f421e46b0c98 HTTP/1.1 Jun 08 02:05:32.288530 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept: application/json Jun 08 02:05:32.288530 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jun 08 02:05:32.288530 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Connection: close Jun 08 02:05:32.288530 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jun 08 02:05:32.288530 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jun 08 02:05:32.288530 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Host: 10.222.0.20 Jun 08 02:05:32.288530 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jun 08 02:05:32.288530 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jun 08 02:05:32.288530 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABioAPgs21bXVDUDCEOghgdFrimxm4cU1ObTOQHgKDSJi73LykS8P2oBBvgN8AIEDwXW0PZuq_121c0jL-qlg-8V8yMlenoQCL7B9ohrcuLaIWHEWyDXkbgzidbrrWmZFlZ_xLcxJPynt5uGXa-POwwOjLuuu3RE1PsTC2A1DzytrMJYM0 Jun 08 02:05:32.288530 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jun 08 02:05:32.288530 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jun 08 02:05:32.288530 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jun 08 02:05:32.288530 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jun 08 02:05:32.288530 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jun 08 02:05:32.288530 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jun 08 02:05:32.288530 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Id: 8b762d2e87da463dac84eedfdedbeb7f Jun 08 02:05:32.288530 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-496295453 Jun 08 02:05:32.288530 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jun 08 02:05:32.288530 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jun 08 02:05:32.289918 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8b762d2e87da463dac84eedfdedbeb7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8b762d2e87da463dac84eedfdedbeb7f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8b762d2e87da463dac84eedfdedbeb7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8b762d2e87da463dac84eedfdedbeb7f"}]}] Jun 08 02:05:32.289918 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-VolumesSnapshotsTestJSON-496295453 Jun 08 02:05:32.289918 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 8b762d2e87da463dac84eedfdedbeb7f Jun 08 02:05:32.289918 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-496295453 Jun 08 02:05:32.289918 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User: tempest-VolumesSnapshotsTestJSON-496295453-project Jun 08 02:05:32.289918 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jun 08 02:05:32.289918 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jun 08 02:05:32.289918 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Id: 7ae96cbf198740ec94313c7f0a5f6179 Jun 08 02:05:32.289918 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-VolumesSnapshotsTestJSON-496295453-project Jun 08 02:05:32.289918 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: method: Jun 08 02:05:32.289918 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: exception: Volume 8acd9961-20cd-4a62-81bd-f421e46b0c98 could not be found. Jun 08 02:05:32.289918 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: action_args: {'id': '8acd9961-20cd-4a62-81bd-f421e46b0c98'} Jun 08 02:05:32.289918 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:05:32.290686 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:32.290686 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 08 02:05:32.290686 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 08 02:05:32.290686 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 08 02:05:32.290686 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 08 02:05:32.290686 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 08 02:05:32.290686 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 08 02:05:32.290686 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 08 02:05:32.290686 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 08 02:05:32.290686 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 08 02:05:32.290686 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 08 02:05:32.290686 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 08 02:05:32.290686 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 08 02:05:32.290686 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 08 02:05:32.290686 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 08 02:05:32.290686 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8acd9961-20cd-4a62-81bd-f421e46b0c98 could not be found. (HTTP 404) (Request-ID: req-d2b45727-54fa-4bcb-b315-05212c93f868) Jun 08 02:05:32.290686 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:32.290686 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:05:32.290686 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:32.291810 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:32.291810 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 08 02:05:32.291810 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 08 02:05:32.291810 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 08 02:05:32.291810 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 08 02:05:32.291810 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 08 02:05:32.291810 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 08 02:05:32.291810 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 08 02:05:32.291810 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 08 02:05:32.291810 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 08 02:05:32.291810 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 08 02:05:32.291810 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 08 02:05:32.291810 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 08 02:05:32.291810 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 08 02:05:32.291810 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 08 02:05:32.291810 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 08 02:05:32.291810 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 08 02:05:32.291810 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 08 02:05:32.291810 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 08 02:05:32.293062 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 08 02:05:32.293062 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 08 02:05:32.293062 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 08 02:05:32.293062 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 08 02:05:32.293062 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8acd9961-20cd-4a62-81bd-f421e46b0c98 could not be found. Jun 08 02:05:32.293062 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:32.293062 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:05:32.293062 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:32.293062 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:32.293062 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:05:32.293062 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:05:32.293062 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:05:32.293062 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:05:32.293062 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 08 02:05:32.293062 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 08 02:05:32.293062 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:05:32.293062 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:05:32.293062 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 08 02:05:32.293062 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:05:32.294735 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8acd9961-20cd-4a62-81bd-f421e46b0c98 could not be found. Jun 08 02:05:32.294735 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:32.294735 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:05:32.294735 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:32.294735 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:32.294735 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:05:32.294735 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:05:32.294735 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:05:32.294735 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:05:32.294735 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8acd9961-20cd-4a62-81bd-f421e46b0c98 could not be found. Jun 08 02:05:32.294735 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:32.300360 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-cf6e1288-3759-4186-a42f-1706186d2460 tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] Returning 404 to user: Volume 8acd9961-20cd-4a62-81bd-f421e46b0c98 could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:05:32.301533 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-cf6e1288-3759-4186-a42f-1706186d2460 tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/8acd9961-20cd-4a62-81bd-f421e46b0c98" status: 404 len: 109 microversion: 2.1 time: 0.103059 Jun 08 02:05:32.304558 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 20/38] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jun 8 02:05:32 2022] GET /compute/v2.1/os-volumes/8acd9961-20cd-4a62-81bd-f421e46b0c98 => generated 109 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 02:05:32.319224 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e57001a5-e759-4578-84fe-e0253063d5df tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] Calling method '.version_select at 0x7f837178d700>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:32.391704 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-e57001a5-e759-4578-84fe-e0253063d5df tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] HTTP exception thrown: Volume 8acd9961-20cd-4a62-81bd-f421e46b0c98 could not be found. Jun 08 02:05:32.394478 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e57001a5-e759-4578-84fe-e0253063d5df tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] Request method failure captured: Jun 08 02:05:32.394478 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: request: DELETE /compute/v2.1/os-volumes/8acd9961-20cd-4a62-81bd-f421e46b0c98 HTTP/1.1 Jun 08 02:05:32.394478 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept: application/json Jun 08 02:05:32.394478 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jun 08 02:05:32.394478 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Connection: close Jun 08 02:05:32.394478 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jun 08 02:05:32.394478 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jun 08 02:05:32.394478 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Host: 10.222.0.20 Jun 08 02:05:32.394478 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jun 08 02:05:32.394478 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jun 08 02:05:32.394478 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABioAPgs21bXVDUDCEOghgdFrimxm4cU1ObTOQHgKDSJi73LykS8P2oBBvgN8AIEDwXW0PZuq_121c0jL-qlg-8V8yMlenoQCL7B9ohrcuLaIWHEWyDXkbgzidbrrWmZFlZ_xLcxJPynt5uGXa-POwwOjLuuu3RE1PsTC2A1DzytrMJYM0 Jun 08 02:05:32.394478 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jun 08 02:05:32.394478 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jun 08 02:05:32.394478 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jun 08 02:05:32.394478 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jun 08 02:05:32.394478 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jun 08 02:05:32.394478 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jun 08 02:05:32.394478 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Id: 8b762d2e87da463dac84eedfdedbeb7f Jun 08 02:05:32.394478 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-496295453 Jun 08 02:05:32.394478 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jun 08 02:05:32.394478 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jun 08 02:05:32.395494 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8b762d2e87da463dac84eedfdedbeb7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8b762d2e87da463dac84eedfdedbeb7f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8b762d2e87da463dac84eedfdedbeb7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8b762d2e87da463dac84eedfdedbeb7f"}]}] Jun 08 02:05:32.395494 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-VolumesSnapshotsTestJSON-496295453 Jun 08 02:05:32.395494 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 8b762d2e87da463dac84eedfdedbeb7f Jun 08 02:05:32.395494 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-496295453 Jun 08 02:05:32.395494 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User: tempest-VolumesSnapshotsTestJSON-496295453-project Jun 08 02:05:32.395494 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jun 08 02:05:32.395494 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jun 08 02:05:32.395494 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Id: 7ae96cbf198740ec94313c7f0a5f6179 Jun 08 02:05:32.395494 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-VolumesSnapshotsTestJSON-496295453-project Jun 08 02:05:32.395494 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: method: Jun 08 02:05:32.395494 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: exception: Volume 8acd9961-20cd-4a62-81bd-f421e46b0c98 could not be found. Jun 08 02:05:32.395494 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: action_args: {'id': '8acd9961-20cd-4a62-81bd-f421e46b0c98'} Jun 08 02:05:32.395494 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:05:32.396108 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:32.396108 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 08 02:05:32.396108 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 08 02:05:32.396108 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 08 02:05:32.396108 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 08 02:05:32.396108 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 08 02:05:32.396108 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 08 02:05:32.396108 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 08 02:05:32.396108 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 08 02:05:32.396108 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 08 02:05:32.396108 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 08 02:05:32.396108 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 08 02:05:32.396108 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 08 02:05:32.396108 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 08 02:05:32.396108 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 08 02:05:32.396108 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8acd9961-20cd-4a62-81bd-f421e46b0c98 could not be found. (HTTP 404) (Request-ID: req-ae65cc36-8ce6-4bb8-ac15-c700a38f947d) Jun 08 02:05:32.396108 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:32.396108 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:05:32.396108 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:32.397648 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:32.397648 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 08 02:05:32.397648 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 08 02:05:32.397648 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 08 02:05:32.397648 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 08 02:05:32.397648 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 08 02:05:32.397648 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 08 02:05:32.397648 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 08 02:05:32.397648 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 08 02:05:32.397648 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 08 02:05:32.397648 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 08 02:05:32.397648 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 08 02:05:32.397648 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 08 02:05:32.397648 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 08 02:05:32.397648 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 08 02:05:32.397648 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 08 02:05:32.397648 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 08 02:05:32.397648 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 08 02:05:32.397648 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 08 02:05:32.398633 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 08 02:05:32.398633 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 08 02:05:32.398633 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 08 02:05:32.398633 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 08 02:05:32.398633 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8acd9961-20cd-4a62-81bd-f421e46b0c98 could not be found. Jun 08 02:05:32.398633 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:32.398633 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:05:32.398633 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:32.398633 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:32.398633 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:05:32.398633 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:05:32.398633 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:05:32.398633 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:05:32.398633 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 08 02:05:32.398633 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 08 02:05:32.398633 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:05:32.398633 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:05:32.398633 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 08 02:05:32.398633 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:05:32.399507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8acd9961-20cd-4a62-81bd-f421e46b0c98 could not be found. Jun 08 02:05:32.399507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:32.399507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:05:32.399507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:32.399507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:32.399507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:05:32.399507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:05:32.399507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:05:32.399507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:05:32.399507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8acd9961-20cd-4a62-81bd-f421e46b0c98 could not be found. Jun 08 02:05:32.399507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:32.401971 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e57001a5-e759-4578-84fe-e0253063d5df tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] Returning 404 to user: Volume 8acd9961-20cd-4a62-81bd-f421e46b0c98 could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:05:32.403125 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e57001a5-e759-4578-84fe-e0253063d5df tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/8acd9961-20cd-4a62-81bd-f421e46b0c98" status: 404 len: 109 microversion: 2.1 time: 0.089712 Jun 08 02:05:32.403898 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 21/39] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Jun 8 02:05:32 2022] DELETE /compute/v2.1/os-volumes/8acd9961-20cd-4a62-81bd-f421e46b0c98 => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 08 02:05:32.413169 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e526cf18-fe82-459e-b142-848a8c5aa7e7 tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] Calling method '.version_select at 0x7f8370d8c160>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:32.507015 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-e526cf18-fe82-459e-b142-848a8c5aa7e7 tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] HTTP exception thrown: Volume 8acd9961-20cd-4a62-81bd-f421e46b0c98 could not be found. Jun 08 02:05:32.510291 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e526cf18-fe82-459e-b142-848a8c5aa7e7 tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] Request method failure captured: Jun 08 02:05:32.510291 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/os-volumes/8acd9961-20cd-4a62-81bd-f421e46b0c98 HTTP/1.1 Jun 08 02:05:32.510291 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept: application/json Jun 08 02:05:32.510291 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jun 08 02:05:32.510291 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Connection: close Jun 08 02:05:32.510291 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jun 08 02:05:32.510291 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jun 08 02:05:32.510291 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Host: 10.222.0.20 Jun 08 02:05:32.510291 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jun 08 02:05:32.510291 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jun 08 02:05:32.510291 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABioAPgs21bXVDUDCEOghgdFrimxm4cU1ObTOQHgKDSJi73LykS8P2oBBvgN8AIEDwXW0PZuq_121c0jL-qlg-8V8yMlenoQCL7B9ohrcuLaIWHEWyDXkbgzidbrrWmZFlZ_xLcxJPynt5uGXa-POwwOjLuuu3RE1PsTC2A1DzytrMJYM0 Jun 08 02:05:32.510291 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jun 08 02:05:32.510291 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jun 08 02:05:32.510291 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jun 08 02:05:32.510291 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jun 08 02:05:32.510291 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jun 08 02:05:32.510291 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jun 08 02:05:32.510291 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Id: 8b762d2e87da463dac84eedfdedbeb7f Jun 08 02:05:32.510291 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-496295453 Jun 08 02:05:32.510291 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jun 08 02:05:32.510291 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jun 08 02:05:32.511352 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8b762d2e87da463dac84eedfdedbeb7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8b762d2e87da463dac84eedfdedbeb7f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8b762d2e87da463dac84eedfdedbeb7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8b762d2e87da463dac84eedfdedbeb7f"}]}] Jun 08 02:05:32.511352 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-VolumesSnapshotsTestJSON-496295453 Jun 08 02:05:32.511352 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 8b762d2e87da463dac84eedfdedbeb7f Jun 08 02:05:32.511352 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-496295453 Jun 08 02:05:32.511352 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User: tempest-VolumesSnapshotsTestJSON-496295453-project Jun 08 02:05:32.511352 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jun 08 02:05:32.511352 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jun 08 02:05:32.511352 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Id: 7ae96cbf198740ec94313c7f0a5f6179 Jun 08 02:05:32.511352 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-VolumesSnapshotsTestJSON-496295453-project Jun 08 02:05:32.511352 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: method: Jun 08 02:05:32.511352 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: exception: Volume 8acd9961-20cd-4a62-81bd-f421e46b0c98 could not be found. Jun 08 02:05:32.511352 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: action_args: {'id': '8acd9961-20cd-4a62-81bd-f421e46b0c98'} Jun 08 02:05:32.511352 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:05:32.512474 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:32.512474 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 08 02:05:32.512474 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 08 02:05:32.512474 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 08 02:05:32.512474 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 08 02:05:32.512474 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 08 02:05:32.512474 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 08 02:05:32.512474 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 08 02:05:32.512474 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 08 02:05:32.512474 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 08 02:05:32.512474 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 08 02:05:32.512474 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 08 02:05:32.512474 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 08 02:05:32.512474 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 08 02:05:32.512474 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 08 02:05:32.512474 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8acd9961-20cd-4a62-81bd-f421e46b0c98 could not be found. (HTTP 404) (Request-ID: req-33323942-2e5e-4f5b-ada9-ff70b9a0828f) Jun 08 02:05:32.512474 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:32.512474 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:05:32.512474 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:32.513507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:32.513507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 08 02:05:32.513507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 08 02:05:32.513507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 08 02:05:32.513507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 08 02:05:32.513507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 08 02:05:32.513507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 08 02:05:32.513507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 08 02:05:32.513507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 08 02:05:32.513507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 08 02:05:32.513507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 08 02:05:32.513507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 08 02:05:32.513507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 08 02:05:32.513507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 08 02:05:32.513507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 08 02:05:32.513507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 08 02:05:32.513507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 08 02:05:32.513507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 08 02:05:32.513507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 08 02:05:32.514555 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 08 02:05:32.514555 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 08 02:05:32.514555 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 08 02:05:32.514555 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 08 02:05:32.514555 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8acd9961-20cd-4a62-81bd-f421e46b0c98 could not be found. Jun 08 02:05:32.514555 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:32.514555 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:05:32.514555 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:32.514555 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:32.514555 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:05:32.514555 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:05:32.514555 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:05:32.514555 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:05:32.514555 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 08 02:05:32.514555 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 08 02:05:32.514555 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:05:32.514555 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:05:32.514555 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 08 02:05:32.514555 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:05:32.515601 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8acd9961-20cd-4a62-81bd-f421e46b0c98 could not be found. Jun 08 02:05:32.515601 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:32.515601 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:05:32.515601 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:32.515601 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:32.515601 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:05:32.515601 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:05:32.515601 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:05:32.515601 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:05:32.515601 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8acd9961-20cd-4a62-81bd-f421e46b0c98 could not be found. Jun 08 02:05:32.515601 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:32.515601 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e526cf18-fe82-459e-b142-848a8c5aa7e7 tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] Returning 404 to user: Volume 8acd9961-20cd-4a62-81bd-f421e46b0c98 could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:05:32.515601 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e526cf18-fe82-459e-b142-848a8c5aa7e7 tempest-VolumesSnapshotsTestJSON-496295453 tempest-VolumesSnapshotsTestJSON-496295453-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/8acd9961-20cd-4a62-81bd-f421e46b0c98" status: 404 len: 109 microversion: 2.1 time: 0.103241 Jun 08 02:05:32.517299 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 22/40] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jun 8 02:05:32 2022] GET /compute/v2.1/os-volumes/8acd9961-20cd-4a62-81bd-f421e46b0c98 => generated 109 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 08 02:05:32.687552 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b9010af4-a327-4c5d-a3b2-93194167f711 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Action: 'create', calling method: .version_select at 0x7f83703e3f70>, body: {"keypair": {"name": "tempest-keypair-668875470", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnp0TltMXMdZYJXFk7wAY9lMlYz75i5Qem626kdr3MCGiiFuMK2qDa8l9NqE/vNx2nvsPSe7JCVQOTa5+UGuEHWJ0TNLsQ9daPVKC5V0tLHq6rbTEOwXeHx3VBFPuZ6/w=="}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:05:32.765719 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ec74537f-8a7e-4238-86ed-2202f3c42f55 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:32.767011 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ec74537f-8a7e-4238-86ed-2202f3c42f55 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:32.774080 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-b9010af4-a327-4c5d-a3b2-93194167f711 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Getting quotas for project 27f98152ab3440cf824c9ceb1c790bcf. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 02:05:32.776599 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ec74537f-8a7e-4238-86ed-2202f3c42f55 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:32.779568 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ec74537f-8a7e-4238-86ed-2202f3c42f55 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:32.784763 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ec74537f-8a7e-4238-86ed-2202f3c42f55 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:32.785548 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ec74537f-8a7e-4238-86ed-2202f3c42f55 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:32.792278 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-b9010af4-a327-4c5d-a3b2-93194167f711 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Getting quotas for user 1b43d2b8b9084099b832332a565e741c and project 27f98152ab3440cf824c9ceb1c790bcf. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 02:05:32.929146 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b9010af4-a327-4c5d-a3b2-93194167f711 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.116025 Jun 08 02:05:32.935621 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 19/41] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jun 8 02:05:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:05:33.008654 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ec74537f-8a7e-4238-86ed-2202f3c42f55 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee50293b204bedb1ea03d77b940514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b90d01b80e450b9357d02c245c9531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:33.022982 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ec74537f-8a7e-4238-86ed-2202f3c42f55 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475" status: 200 len: 1273 microversion: 2.1 time: 0.260615 Jun 08 02:05:33.024703 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 23/42] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:32 2022] GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 => generated 1273 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:05:34.042516 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ffba6a49-f2dc-4146-aee0-9f34b7e2ddb1 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:34.043126 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ffba6a49-f2dc-4146-aee0-9f34b7e2ddb1 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:34.057383 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ffba6a49-f2dc-4146-aee0-9f34b7e2ddb1 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:34.074000 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ffba6a49-f2dc-4146-aee0-9f34b7e2ddb1 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:34.076323 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ffba6a49-f2dc-4146-aee0-9f34b7e2ddb1 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:34.080062 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ffba6a49-f2dc-4146-aee0-9f34b7e2ddb1 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:34.864671 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:05:35.527112 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ffba6a49-f2dc-4146-aee0-9f34b7e2ddb1 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee50293b204bedb1ea03d77b940514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b90d01b80e450b9357d02c245c9531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:35.549979 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ffba6a49-f2dc-4146-aee0-9f34b7e2ddb1 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475" status: 200 len: 1315 microversion: 2.1 time: 1.512666 Jun 08 02:05:35.550607 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 20/43] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:34 2022] GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 => generated 1315 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:05:36.569288 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-7b1adfa0-06cc-460e-8cc9-5c5f2375c25f tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:36.569945 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-7b1adfa0-06cc-460e-8cc9-5c5f2375c25f tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:36.584224 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7b1adfa0-06cc-460e-8cc9-5c5f2375c25f tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:36.589040 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7b1adfa0-06cc-460e-8cc9-5c5f2375c25f tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:36.597101 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7b1adfa0-06cc-460e-8cc9-5c5f2375c25f tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:36.598115 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7b1adfa0-06cc-460e-8cc9-5c5f2375c25f tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:37.385776 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7b1adfa0-06cc-460e-8cc9-5c5f2375c25f tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee50293b204bedb1ea03d77b940514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b90d01b80e450b9357d02c245c9531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:37.402971 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-7b1adfa0-06cc-460e-8cc9-5c5f2375c25f tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475" status: 200 len: 1315 microversion: 2.1 time: 0.838099 Jun 08 02:05:37.424669 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 24/44] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:36 2022] GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 => generated 1315 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:05:37.855547 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b2b34b89-e516-445d-bcae-ff7a6509bc02 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1349422539", "imageRef": "e648e482-e374-429d-8152-a4a63797f314", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:05:37.955294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.network.neutron [None req-b2b34b89-e516-445d-bcae-ff7a6509bc02 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] validate_networks() for [('eafc844b-6465-4613-a6dd-f1b9698164f0', None, None, None, None, None)] {{(pid=117938) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 02:05:38.426870 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-78573b78-8dbb-4a05-b607-ed91e90e8c40 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:38.436641 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-78573b78-8dbb-4a05-b607-ed91e90e8c40 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:38.450494 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=2 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:05:38.473566 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-78573b78-8dbb-4a05-b607-ed91e90e8c40 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:38.478287 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-78573b78-8dbb-4a05-b607-ed91e90e8c40 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:38.480368 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-78573b78-8dbb-4a05-b607-ed91e90e8c40 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:38.481293 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-78573b78-8dbb-4a05-b607-ed91e90e8c40 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:39.633351 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-78573b78-8dbb-4a05-b607-ed91e90e8c40 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee50293b204bedb1ea03d77b940514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b90d01b80e450b9357d02c245c9531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:39.647015 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-78573b78-8dbb-4a05-b607-ed91e90e8c40 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475" status: 200 len: 1315 microversion: 2.1 time: 1.226139 Jun 08 02:05:39.654991 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 25/45] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:38 2022] GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 => generated 1315 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:05:40.676591 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c6ef24b9-0ea0-4d39-a0a7-b5dc29868e91 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:40.677434 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c6ef24b9-0ea0-4d39-a0a7-b5dc29868e91 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:40.685778 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c6ef24b9-0ea0-4d39-a0a7-b5dc29868e91 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:40.686577 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c6ef24b9-0ea0-4d39-a0a7-b5dc29868e91 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:40.687576 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c6ef24b9-0ea0-4d39-a0a7-b5dc29868e91 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:40.688217 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c6ef24b9-0ea0-4d39-a0a7-b5dc29868e91 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:41.609395 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c6ef24b9-0ea0-4d39-a0a7-b5dc29868e91 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee50293b204bedb1ea03d77b940514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b90d01b80e450b9357d02c245c9531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:41.617691 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c6ef24b9-0ea0-4d39-a0a7-b5dc29868e91 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475" status: 200 len: 1315 microversion: 2.1 time: 0.949873 Jun 08 02:05:41.618274 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 26/46] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:40 2022] GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 => generated 1315 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:05:41.846343 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-b2b34b89-e516-445d-bcae-ff7a6509bc02 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Flavor limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 02:05:41.846343 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-b2b34b89-e516-445d-bcae-ff7a6509bc02 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Image limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 02:05:41.847037 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-b2b34b89-e516-445d-bcae-ff7a6509bc02 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Flavor pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 02:05:41.847119 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-b2b34b89-e516-445d-bcae-ff7a6509bc02 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Image pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 02:05:41.847531 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-b2b34b89-e516-445d-bcae-ff7a6509bc02 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 02:05:41.876643 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b2b34b89-e516-445d-bcae-ff7a6509bc02 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:41.877103 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b2b34b89-e516-445d-bcae-ff7a6509bc02 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:41.877967 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b2b34b89-e516-445d-bcae-ff7a6509bc02 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:41.878462 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b2b34b89-e516-445d-bcae-ff7a6509bc02 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:41.938973 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-b2b34b89-e516-445d-bcae-ff7a6509bc02 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Getting quotas for project d40d753f66ec4ed2808aa65b825e66f8. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 02:05:41.955521 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-b2b34b89-e516-445d-bcae-ff7a6509bc02 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Getting quotas for user 9e13bd970d2e4d67b62452ae0d6cae56 and project d40d753f66ec4ed2808aa65b825e66f8. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 02:05:42.029197 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b2b34b89-e516-445d-bcae-ff7a6509bc02 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Going to run 1 instances... {{(pid=117938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 02:05:42.038885 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b2b34b89-e516-445d-bcae-ff7a6509bc02 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e648e482-e374-429d-8152-a4a63797f314',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 02:05:42.232294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b2b34b89-e516-445d-bcae-ff7a6509bc02 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.492226 Jun 08 02:05:42.241663 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 21/47] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jun 8 02:05:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 5504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 08 02:05:42.246000 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2fa8ad15-b6da-4f2d-b2c1-422265494101 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:42.246617 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-2fa8ad15-b6da-4f2d-b2c1-422265494101 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:42.532862 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2fa8ad15-b6da-4f2d-b2c1-422265494101 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:42.541467 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2fa8ad15-b6da-4f2d-b2c1-422265494101 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1222 microversion: 2.1 time: 0.299130 Jun 08 02:05:42.548110 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 27/48] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:42 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1222 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:05:42.639173 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-37e63443-9cef-4310-9a9c-903cb2bfa17f tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:42.640001 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-37e63443-9cef-4310-9a9c-903cb2bfa17f tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:42.675548 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-37e63443-9cef-4310-9a9c-903cb2bfa17f tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:42.681204 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-37e63443-9cef-4310-9a9c-903cb2bfa17f tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:42.682547 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-37e63443-9cef-4310-9a9c-903cb2bfa17f tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:42.683015 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-37e63443-9cef-4310-9a9c-903cb2bfa17f tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:43.846246 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-39a59b95-349c-48ab-9b79-1df21ccf305d tempest-VolumesNegativeTest-611382554 tempest-VolumesNegativeTest-611382554-project] Action: 'create', calling method: .version_select at 0x7f8370d03a60>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-368550773", "metadata": {"Type": "work"}}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:05:43.948812 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-39a59b95-349c-48ab-9b79-1df21ccf305d tempest-VolumesNegativeTest-611382554 tempest-VolumesNegativeTest-611382554-project] Request method failure captured: Jun 08 02:05:43.948812 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 08 02:05:43.948812 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept: application/json Jun 08 02:05:43.948812 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jun 08 02:05:43.948812 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Connection: close Jun 08 02:05:43.948812 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Length: 121 Jun 08 02:05:43.948812 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jun 08 02:05:43.948812 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Host: 10.222.0.20 Jun 08 02:05:43.948812 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jun 08 02:05:43.948812 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jun 08 02:05:43.948812 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABioAP2OuzaKcUOJ0dVNth3LinG6xSfV7EX-KK73FaoM6YWzXWOLMRScbGDTTzbL8ipNCthncMGrAgyAyqO4fR3zh_OlTTyrH4YUx0fltjfldWAKiTA77Puzxha71cDgjn6K3LNzJXPMxC6T_X7rm4ZQD0RG-bZhIInqvz6GgxEQEu-cgk Jun 08 02:05:43.948812 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jun 08 02:05:43.948812 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jun 08 02:05:43.948812 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jun 08 02:05:43.948812 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jun 08 02:05:43.948812 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jun 08 02:05:43.948812 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jun 08 02:05:43.948812 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Id: d0a179fd2abc4e4eae4ecf26761efcc7 Jun 08 02:05:43.948812 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-VolumesNegativeTest-611382554 Jun 08 02:05:43.948812 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jun 08 02:05:43.948812 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jun 08 02:05:43.956967 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0a179fd2abc4e4eae4ecf26761efcc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0a179fd2abc4e4eae4ecf26761efcc7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0a179fd2abc4e4eae4ecf26761efcc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0a179fd2abc4e4eae4ecf26761efcc7"}]}] Jun 08 02:05:43.956967 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-VolumesNegativeTest-611382554 Jun 08 02:05:43.956967 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Id: d0a179fd2abc4e4eae4ecf26761efcc7 Jun 08 02:05:43.956967 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-VolumesNegativeTest-611382554 Jun 08 02:05:43.956967 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User: tempest-VolumesNegativeTest-611382554-project Jun 08 02:05:43.956967 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jun 08 02:05:43.956967 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jun 08 02:05:43.956967 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Id: f3dbf37ddeee414684101d875e763a01 Jun 08 02:05:43.956967 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-VolumesNegativeTest-611382554-project Jun 08 02:05:43.956967 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Jun 08 02:05:43.956967 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-368550773", "metadata": {"Type": "work"}}} Jun 08 02:05:43.956967 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: method: Jun 08 02:05:43.956967 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 08 02:05:43.961202 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-368550773', 'metadata': {'Type': 'work'}}}} Jun 08 02:05:43.961202 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:05:43.961202 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:43.961202 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 08 02:05:43.961202 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 08 02:05:43.961202 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 08 02:05:43.961202 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise error Jun 08 02:05:43.961202 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 08 02:05:43.961202 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:43.961202 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 08 02:05:43.961202 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 08 02:05:43.961202 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:43.961202 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 08 02:05:43.961202 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi '#$%' Jun 08 02:05:43.961202 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:43.961202 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:05:43.961202 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:43.961202 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:43.961202 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:05:43.961202 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:05:43.961202 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:05:43.961202 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:05:43.969359 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 08 02:05:43.969359 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 08 02:05:43.969359 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:05:43.969359 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:05:43.969359 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 08 02:05:43.969359 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 08 02:05:43.969359 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 08 02:05:43.969359 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 08 02:05:43.969359 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 08 02:05:43.969359 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 08 02:05:43.969359 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 08 02:05:43.969359 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:43.969359 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:05:43.969359 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:43.969359 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:43.969359 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:05:43.969359 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:05:43.969359 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 08 02:05:43.969359 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 08 02:05:43.971444 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 08 02:05:43.971444 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:43.971444 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-39a59b95-349c-48ab-9b79-1df21ccf305d tempest-VolumesNegativeTest-611382554 tempest-VolumesNegativeTest-611382554-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:05:43.979088 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-39a59b95-349c-48ab-9b79-1df21ccf305d tempest-VolumesNegativeTest-611382554 tempest-VolumesNegativeTest-611382554-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.970230 Jun 08 02:05:43.985193 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 28/49] 10.222.0.20 () {60 vars in 1155 bytes} [Wed Jun 8 02:05:42 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 991 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 08 02:05:43.992048 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b43b9a81-0ea0-47f0-9b7e-9732b1c721c4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1730797762", "imageRef": "e648e482-e374-429d-8152-a4a63797f314", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:05:44.203638 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.network.neutron [None req-b43b9a81-0ea0-47f0-9b7e-9732b1c721c4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] validate_networks() for [('eafc844b-6465-4613-a6dd-f1b9698164f0', None, None, None, None, None)] {{(pid=117939) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 02:05:44.736734 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-37e63443-9cef-4310-9a9c-903cb2bfa17f tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee50293b204bedb1ea03d77b940514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b90d01b80e450b9357d02c245c9531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:44.747049 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-37e63443-9cef-4310-9a9c-903cb2bfa17f tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475" status: 200 len: 1315 microversion: 2.1 time: 2.113381 Jun 08 02:05:44.748159 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 22/50] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:42 2022] GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 => generated 1315 bytes in 2115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:05:44.753864 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-089722ee-b016-411a-8a75-6856f9691039 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-518589686", "imageRef": "e648e482-e374-429d-8152-a4a63797f314", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "466dc4d7-a525-4704-a47b-5a136472c918"}], "security_groups": [{"name": "tempest-securitygroup--310407534"}], "key_name": "tempest-keypair-668875470", "user_data": "}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:05:44.971177 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.network.neutron [None req-089722ee-b016-411a-8a75-6856f9691039 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] validate_networks() for [('466dc4d7-a525-4704-a47b-5a136472c918', None, None, None, None, None)] {{(pid=117938) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 02:05:45.896695 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-b43b9a81-0ea0-47f0-9b7e-9732b1c721c4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Flavor limits 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 02:05:45.898134 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-b43b9a81-0ea0-47f0-9b7e-9732b1c721c4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Image limits 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 02:05:45.898924 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-b43b9a81-0ea0-47f0-9b7e-9732b1c721c4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Flavor pref 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 02:05:45.900184 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-b43b9a81-0ea0-47f0-9b7e-9732b1c721c4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Image pref 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 02:05:45.900888 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-b43b9a81-0ea0-47f0-9b7e-9732b1c721c4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 02:05:45.918322 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b43b9a81-0ea0-47f0-9b7e-9732b1c721c4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:45.919787 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b43b9a81-0ea0-47f0-9b7e-9732b1c721c4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:45.920985 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b43b9a81-0ea0-47f0-9b7e-9732b1c721c4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:45.921715 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b43b9a81-0ea0-47f0-9b7e-9732b1c721c4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:45.973345 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-b43b9a81-0ea0-47f0-9b7e-9732b1c721c4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Getting quotas for project d40d753f66ec4ed2808aa65b825e66f8. Resources: {'cores', 'ram', 'instances'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 02:05:45.984279 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-b43b9a81-0ea0-47f0-9b7e-9732b1c721c4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Getting quotas for user 9e13bd970d2e4d67b62452ae0d6cae56 and project d40d753f66ec4ed2808aa65b825e66f8. Resources: {'cores', 'ram', 'instances'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 02:05:46.005775 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-b43b9a81-0ea0-47f0-9b7e-9732b1c721c4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Going to run 1 instances... {{(pid=117939) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 02:05:46.008927 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-b43b9a81-0ea0-47f0-9b7e-9732b1c721c4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e648e482-e374-429d-8152-a4a63797f314',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 02:05:46.110782 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-089722ee-b016-411a-8a75-6856f9691039 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Flavor limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 02:05:46.112429 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-089722ee-b016-411a-8a75-6856f9691039 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Image limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 02:05:46.112429 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-089722ee-b016-411a-8a75-6856f9691039 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Flavor pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 02:05:46.112823 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-089722ee-b016-411a-8a75-6856f9691039 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Image pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 02:05:46.113242 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-089722ee-b016-411a-8a75-6856f9691039 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 02:05:46.118679 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-b43b9a81-0ea0-47f0-9b7e-9732b1c721c4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.132301 Jun 08 02:05:46.124719 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 29/51] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jun 8 02:05:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 2139 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 08 02:05:46.126726 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-089722ee-b016-411a-8a75-6856f9691039 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:46.129485 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-089722ee-b016-411a-8a75-6856f9691039 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:46.130425 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-089722ee-b016-411a-8a75-6856f9691039 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:46.131139 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-089722ee-b016-411a-8a75-6856f9691039 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:46.141423 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-59eb0c67-9f5a-4dd0-a5c5-2039e2ef1f3b tempest-VolumesNegativeTest-611382554 tempest-VolumesNegativeTest-611382554-project] Action: 'create', calling method: .version_select at 0x7f837032e310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-733748597", "metadata": {"Type": "work"}}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:05:46.150815 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-089722ee-b016-411a-8a75-6856f9691039 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Getting quotas for project 27f98152ab3440cf824c9ceb1c790bcf. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 02:05:46.153581 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-59eb0c67-9f5a-4dd0-a5c5-2039e2ef1f3b tempest-VolumesNegativeTest-611382554 tempest-VolumesNegativeTest-611382554-project] Request method failure captured: Jun 08 02:05:46.153581 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 08 02:05:46.153581 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept: application/json Jun 08 02:05:46.153581 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jun 08 02:05:46.153581 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Connection: close Jun 08 02:05:46.153581 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Length: 119 Jun 08 02:05:46.153581 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jun 08 02:05:46.153581 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Host: 10.222.0.20 Jun 08 02:05:46.153581 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jun 08 02:05:46.153581 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jun 08 02:05:46.153581 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABioAP2OuzaKcUOJ0dVNth3LinG6xSfV7EX-KK73FaoM6YWzXWOLMRScbGDTTzbL8ipNCthncMGrAgyAyqO4fR3zh_OlTTyrH4YUx0fltjfldWAKiTA77Puzxha71cDgjn6K3LNzJXPMxC6T_X7rm4ZQD0RG-bZhIInqvz6GgxEQEu-cgk Jun 08 02:05:46.153581 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jun 08 02:05:46.153581 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jun 08 02:05:46.153581 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jun 08 02:05:46.153581 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jun 08 02:05:46.153581 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jun 08 02:05:46.153581 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jun 08 02:05:46.153581 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Id: d0a179fd2abc4e4eae4ecf26761efcc7 Jun 08 02:05:46.153581 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-VolumesNegativeTest-611382554 Jun 08 02:05:46.153581 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jun 08 02:05:46.153581 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jun 08 02:05:46.155059 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0a179fd2abc4e4eae4ecf26761efcc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0a179fd2abc4e4eae4ecf26761efcc7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0a179fd2abc4e4eae4ecf26761efcc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0a179fd2abc4e4eae4ecf26761efcc7"}]}] Jun 08 02:05:46.155059 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-VolumesNegativeTest-611382554 Jun 08 02:05:46.155059 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Id: d0a179fd2abc4e4eae4ecf26761efcc7 Jun 08 02:05:46.155059 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-VolumesNegativeTest-611382554 Jun 08 02:05:46.155059 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User: tempest-VolumesNegativeTest-611382554-project Jun 08 02:05:46.155059 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jun 08 02:05:46.155059 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jun 08 02:05:46.155059 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Id: f3dbf37ddeee414684101d875e763a01 Jun 08 02:05:46.155059 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-VolumesNegativeTest-611382554-project Jun 08 02:05:46.155059 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Jun 08 02:05:46.155059 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-733748597", "metadata": {"Type": "work"}}} Jun 08 02:05:46.155059 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: method: Jun 08 02:05:46.155059 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 08 02:05:46.155901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-733748597', 'metadata': {'Type': 'work'}}}} Jun 08 02:05:46.155901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:05:46.155901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:46.155901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 08 02:05:46.155901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 08 02:05:46.155901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 08 02:05:46.155901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise error Jun 08 02:05:46.155901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 08 02:05:46.155901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:46.155901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 08 02:05:46.155901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 08 02:05:46.155901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:46.155901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 08 02:05:46.155901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi '0' Jun 08 02:05:46.155901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:46.155901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:05:46.155901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:46.155901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:46.155901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:05:46.155901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:05:46.155901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:05:46.155901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:05:46.157375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 08 02:05:46.157375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 08 02:05:46.157375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:05:46.157375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:05:46.157375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 08 02:05:46.157375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 08 02:05:46.157375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 08 02:05:46.157375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 08 02:05:46.157375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 08 02:05:46.157375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 08 02:05:46.157375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 08 02:05:46.157375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:46.157375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:05:46.157375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:46.157375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:46.157375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:05:46.157375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:05:46.157375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 08 02:05:46.157375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 08 02:05:46.158519 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 08 02:05:46.158519 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:46.158519 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-59eb0c67-9f5a-4dd0-a5c5-2039e2ef1f3b tempest-VolumesNegativeTest-611382554 tempest-VolumesNegativeTest-611382554-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:05:46.161263 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-59eb0c67-9f5a-4dd0-a5c5-2039e2ef1f3b tempest-VolumesNegativeTest-611382554 tempest-VolumesNegativeTest-611382554-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.034032 Jun 08 02:05:46.164767 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 30/52] 10.222.0.20 () {60 vars in 1155 bytes} [Wed Jun 8 02:05:46 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 08 02:05:46.169567 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-089722ee-b016-411a-8a75-6856f9691039 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Getting quotas for user 1b43d2b8b9084099b832332a565e741c and project 27f98152ab3440cf824c9ceb1c790bcf. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 02:05:46.194684 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-089722ee-b016-411a-8a75-6856f9691039 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Going to run 1 instances... {{(pid=117938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 02:05:46.197258 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-089722ee-b016-411a-8a75-6856f9691039 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e648e482-e374-429d-8152-a4a63797f314',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 02:05:46.317725 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-089722ee-b016-411a-8a75-6856f9691039 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.562325 Jun 08 02:05:46.329837 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 23/53] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jun 8 02:05:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 1581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 08 02:05:46.358799 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-61117bcb-57fb-40c9-ae76-6442259857e7 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:46.359422 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-61117bcb-57fb-40c9-ae76-6442259857e7 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:46.374563 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-61117bcb-57fb-40c9-ae76-6442259857e7 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:46.375204 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-61117bcb-57fb-40c9-ae76-6442259857e7 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:46.376288 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-61117bcb-57fb-40c9-ae76-6442259857e7 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:46.376889 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-61117bcb-57fb-40c9-ae76-6442259857e7 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:46.547998 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-8051b7c4-33fd-409c-b978-5c6d0dfa0768 req-5547123f-17fd-4d6e-9147-c45ba46e0151 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "400093fe-afb9-4690-9da0-e7a6c7103475", "tag": "732d068c-f7fd-41f4-8c10-2743ccfb57c5"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:05:46.563753 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-8051b7c4-33fd-409c-b978-5c6d0dfa0768 req-5547123f-17fd-4d6e-9147-c45ba46e0151 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:46.564571 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-8051b7c4-33fd-409c-b978-5c6d0dfa0768 req-5547123f-17fd-4d6e-9147-c45ba46e0151 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:46.588850 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-8051b7c4-33fd-409c-b978-5c6d0dfa0768 req-5547123f-17fd-4d6e-9147-c45ba46e0151 service nova] Creating event network-changed:732d068c-f7fd-41f4-8c10-2743ccfb57c5 for instance 400093fe-afb9-4690-9da0-e7a6c7103475 on hv-cinder-84506 Jun 08 02:05:46.589664 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-8051b7c4-33fd-409c-b978-5c6d0dfa0768 req-5547123f-17fd-4d6e-9147-c45ba46e0151 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117939) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 08 02:05:46.590708 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-61117bcb-57fb-40c9-ae76-6442259857e7 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee50293b204bedb1ea03d77b940514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b90d01b80e450b9357d02c245c9531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:46.591401 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ba1b0ac0-5b6a-4042-a52b-2b09b5aeb7b2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:46.592284 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ba1b0ac0-5b6a-4042-a52b-2b09b5aeb7b2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:46.593664 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ba1b0ac0-5b6a-4042-a52b-2b09b5aeb7b2 None None] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:46.594637 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ba1b0ac0-5b6a-4042-a52b-2b09b5aeb7b2 None None] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:46.598368 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-61117bcb-57fb-40c9-ae76-6442259857e7 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475" status: 200 len: 1315 microversion: 2.1 time: 0.267385 Jun 08 02:05:46.602587 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 24/54] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:46 2022] GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:05:46.613112 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9bebaf2c-9abf-4667-93f5-08a61d7d95b6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:46.614399 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9bebaf2c-9abf-4667-93f5-08a61d7d95b6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:46.621136 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.compute.rpcapi [None req-ba1b0ac0-5b6a-4042-a52b-2b09b5aeb7b2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 08 02:05:46.622396 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ba1b0ac0-5b6a-4042-a52b-2b09b5aeb7b2 None None] Releasing lock "compute-rpcapi-router" {{(pid=117939) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 08 02:05:46.623828 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9bebaf2c-9abf-4667-93f5-08a61d7d95b6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:46.624701 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9bebaf2c-9abf-4667-93f5-08a61d7d95b6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:46.625905 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9bebaf2c-9abf-4667-93f5-08a61d7d95b6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:46.626782 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9bebaf2c-9abf-4667-93f5-08a61d7d95b6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:46.650898 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ba1b0ac0-5b6a-4042-a52b-2b09b5aeb7b2 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.482997 Jun 08 02:05:46.651508 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 31/55] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:05:46.658690 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0c82eff9-12ec-4c9d-bcc8-62e995e13c09 tempest-VolumesNegativeTest-611382554 tempest-VolumesNegativeTest-611382554-project] Action: 'create', calling method: .version_select at 0x7f837032e3a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1568893076", "metadata": {"Type": "work"}}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:05:46.662624 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0c82eff9-12ec-4c9d-bcc8-62e995e13c09 tempest-VolumesNegativeTest-611382554 tempest-VolumesNegativeTest-611382554-project] Request method failure captured: Jun 08 02:05:46.662624 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 08 02:05:46.662624 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept: application/json Jun 08 02:05:46.662624 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jun 08 02:05:46.662624 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Connection: close Jun 08 02:05:46.662624 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Length: 119 Jun 08 02:05:46.662624 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jun 08 02:05:46.662624 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Host: 10.222.0.20 Jun 08 02:05:46.662624 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jun 08 02:05:46.662624 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jun 08 02:05:46.662624 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABioAP2OuzaKcUOJ0dVNth3LinG6xSfV7EX-KK73FaoM6YWzXWOLMRScbGDTTzbL8ipNCthncMGrAgyAyqO4fR3zh_OlTTyrH4YUx0fltjfldWAKiTA77Puzxha71cDgjn6K3LNzJXPMxC6T_X7rm4ZQD0RG-bZhIInqvz6GgxEQEu-cgk Jun 08 02:05:46.662624 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jun 08 02:05:46.662624 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jun 08 02:05:46.662624 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jun 08 02:05:46.662624 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jun 08 02:05:46.662624 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jun 08 02:05:46.662624 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jun 08 02:05:46.662624 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Id: d0a179fd2abc4e4eae4ecf26761efcc7 Jun 08 02:05:46.662624 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-VolumesNegativeTest-611382554 Jun 08 02:05:46.662624 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jun 08 02:05:46.662624 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jun 08 02:05:46.663901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0a179fd2abc4e4eae4ecf26761efcc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0a179fd2abc4e4eae4ecf26761efcc7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0a179fd2abc4e4eae4ecf26761efcc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0a179fd2abc4e4eae4ecf26761efcc7"}]}] Jun 08 02:05:46.663901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-VolumesNegativeTest-611382554 Jun 08 02:05:46.663901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Id: d0a179fd2abc4e4eae4ecf26761efcc7 Jun 08 02:05:46.663901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-VolumesNegativeTest-611382554 Jun 08 02:05:46.663901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User: tempest-VolumesNegativeTest-611382554-project Jun 08 02:05:46.663901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jun 08 02:05:46.663901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jun 08 02:05:46.663901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Id: f3dbf37ddeee414684101d875e763a01 Jun 08 02:05:46.663901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-VolumesNegativeTest-611382554-project Jun 08 02:05:46.663901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Jun 08 02:05:46.663901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1568893076", "metadata": {"Type": "work"}}} Jun 08 02:05:46.663901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: method: Jun 08 02:05:46.663901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 08 02:05:46.664582 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1568893076', 'metadata': {'Type': 'work'}}}} Jun 08 02:05:46.664582 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:05:46.664582 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:46.664582 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 08 02:05:46.664582 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 08 02:05:46.664582 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 08 02:05:46.664582 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise error Jun 08 02:05:46.664582 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 08 02:05:46.664582 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:46.664582 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 08 02:05:46.664582 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 08 02:05:46.664582 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:46.664582 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 08 02:05:46.664582 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi '' Jun 08 02:05:46.664582 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:46.664582 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:05:46.664582 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:46.664582 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:46.664582 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:05:46.664582 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:05:46.664582 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:05:46.664582 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:05:46.665670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 08 02:05:46.665670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 08 02:05:46.665670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:05:46.665670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:05:46.665670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 08 02:05:46.665670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 08 02:05:46.665670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 08 02:05:46.665670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 08 02:05:46.665670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 08 02:05:46.665670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 08 02:05:46.665670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 08 02:05:46.665670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:46.665670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:05:46.665670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:46.665670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:46.665670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:05:46.665670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:05:46.665670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 08 02:05:46.665670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 08 02:05:46.666679 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 08 02:05:46.666679 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:46.668588 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0c82eff9-12ec-4c9d-bcc8-62e995e13c09 tempest-VolumesNegativeTest-611382554 tempest-VolumesNegativeTest-611382554-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:05:46.669423 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-0c82eff9-12ec-4c9d-bcc8-62e995e13c09 tempest-VolumesNegativeTest-611382554 tempest-VolumesNegativeTest-611382554-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.016443 Jun 08 02:05:46.669987 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 32/56] 10.222.0.20 () {60 vars in 1155 bytes} [Wed Jun 8 02:05:46 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 08 02:05:46.674973 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-7323cd51-c9e5-44fb-b58c-614992ee287c tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:46.676551 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-7323cd51-c9e5-44fb-b58c-614992ee287c tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:46.742909 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9bebaf2c-9abf-4667-93f5-08a61d7d95b6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:46.759975 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7323cd51-c9e5-44fb-b58c-614992ee287c tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:46.764186 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9bebaf2c-9abf-4667-93f5-08a61d7d95b6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1226 microversion: 2.1 time: 0.160328 Jun 08 02:05:46.766548 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 25/57] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:46 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1226 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:05:46.770161 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-7323cd51-c9e5-44fb-b58c-614992ee287c tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1236 microversion: 2.1 time: 0.098849 Jun 08 02:05:46.770726 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 33/58] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:46 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1236 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:05:46.775583 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-963cc924-edec-4a75-8bcd-c1b993f998ad tempest-VolumesNegativeTest-611382554 tempest-VolumesNegativeTest-611382554-project] Calling method '.version_select at 0x7f837033d280>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:46.810351 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-963cc924-edec-4a75-8bcd-c1b993f998ad tempest-VolumesNegativeTest-611382554 tempest-VolumesNegativeTest-611382554-project] HTTP exception thrown: Volume tempest-invalid-739347486 could not be found. Jun 08 02:05:46.812331 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-963cc924-edec-4a75-8bcd-c1b993f998ad tempest-VolumesNegativeTest-611382554 tempest-VolumesNegativeTest-611382554-project] Request method failure captured: Jun 08 02:05:46.812331 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-739347486 HTTP/1.1 Jun 08 02:05:46.812331 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept: application/json Jun 08 02:05:46.812331 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jun 08 02:05:46.812331 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Connection: close Jun 08 02:05:46.812331 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jun 08 02:05:46.812331 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jun 08 02:05:46.812331 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Host: 10.222.0.20 Jun 08 02:05:46.812331 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jun 08 02:05:46.812331 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jun 08 02:05:46.812331 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABioAP2OuzaKcUOJ0dVNth3LinG6xSfV7EX-KK73FaoM6YWzXWOLMRScbGDTTzbL8ipNCthncMGrAgyAyqO4fR3zh_OlTTyrH4YUx0fltjfldWAKiTA77Puzxha71cDgjn6K3LNzJXPMxC6T_X7rm4ZQD0RG-bZhIInqvz6GgxEQEu-cgk Jun 08 02:05:46.812331 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jun 08 02:05:46.812331 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jun 08 02:05:46.812331 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jun 08 02:05:46.812331 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jun 08 02:05:46.812331 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jun 08 02:05:46.812331 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jun 08 02:05:46.812331 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Id: d0a179fd2abc4e4eae4ecf26761efcc7 Jun 08 02:05:46.812331 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-VolumesNegativeTest-611382554 Jun 08 02:05:46.812331 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jun 08 02:05:46.812331 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jun 08 02:05:46.813852 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0a179fd2abc4e4eae4ecf26761efcc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0a179fd2abc4e4eae4ecf26761efcc7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0a179fd2abc4e4eae4ecf26761efcc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0a179fd2abc4e4eae4ecf26761efcc7"}]}] Jun 08 02:05:46.813852 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-VolumesNegativeTest-611382554 Jun 08 02:05:46.813852 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Id: d0a179fd2abc4e4eae4ecf26761efcc7 Jun 08 02:05:46.813852 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-VolumesNegativeTest-611382554 Jun 08 02:05:46.813852 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User: tempest-VolumesNegativeTest-611382554-project Jun 08 02:05:46.813852 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jun 08 02:05:46.813852 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jun 08 02:05:46.813852 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Id: f3dbf37ddeee414684101d875e763a01 Jun 08 02:05:46.813852 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-VolumesNegativeTest-611382554-project Jun 08 02:05:46.813852 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: method: Jun 08 02:05:46.813852 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: exception: Volume tempest-invalid-739347486 could not be found. Jun 08 02:05:46.813852 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: action_args: {'id': 'tempest-invalid-739347486'} Jun 08 02:05:46.813852 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:05:46.814784 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:46.814784 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 08 02:05:46.814784 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 08 02:05:46.814784 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 08 02:05:46.814784 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 08 02:05:46.814784 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 08 02:05:46.814784 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 08 02:05:46.814784 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 08 02:05:46.814784 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 08 02:05:46.814784 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 08 02:05:46.814784 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 08 02:05:46.814784 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 08 02:05:46.814784 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 08 02:05:46.814784 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 08 02:05:46.814784 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 08 02:05:46.814784 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-739347486 could not be found. (HTTP 404) (Request-ID: req-6712ff17-4af8-4f3f-bb46-31371ce41878) Jun 08 02:05:46.814784 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:05:46.814784 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:05:46.814784 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:05:46.815761 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:46.815761 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 08 02:05:46.815761 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 08 02:05:46.815761 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 08 02:05:46.815761 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 08 02:05:46.815761 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 08 02:05:46.815761 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 08 02:05:46.815761 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 08 02:05:46.815761 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 08 02:05:46.815761 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 08 02:05:46.815761 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 08 02:05:46.815761 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 08 02:05:46.815761 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 08 02:05:46.815761 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 08 02:05:46.815761 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 08 02:05:46.815761 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 08 02:05:46.815761 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 08 02:05:46.815761 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 08 02:05:46.815761 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 08 02:05:46.816752 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 08 02:05:46.816752 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 08 02:05:46.816752 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 08 02:05:46.816752 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 08 02:05:46.816752 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-739347486 could not be found. Jun 08 02:05:46.816752 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:05:46.816752 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:05:46.816752 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:05:46.816752 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:46.816752 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:05:46.816752 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:05:46.816752 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:05:46.816752 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:05:46.816752 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 08 02:05:46.816752 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 08 02:05:46.816752 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:05:46.816752 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:05:46.816752 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 08 02:05:46.816752 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:05:46.816752 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-739347486 could not be found. Jun 08 02:05:46.817812 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:05:46.817812 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:05:46.817812 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:05:46.817812 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:46.817812 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:05:46.817812 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:05:46.817812 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:05:46.817812 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:05:46.817812 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-739347486 could not be found. Jun 08 02:05:46.817812 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:05:46.817812 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-963cc924-edec-4a75-8bcd-c1b993f998ad tempest-VolumesNegativeTest-611382554 tempest-VolumesNegativeTest-611382554-project] Returning 404 to user: Volume tempest-invalid-739347486 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:05:46.817812 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-963cc924-edec-4a75-8bcd-c1b993f998ad tempest-VolumesNegativeTest-611382554 tempest-VolumesNegativeTest-611382554-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-739347486" status: 404 len: 98 microversion: 2.1 time: 0.045854 Jun 08 02:05:46.817812 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 26/59] 10.222.0.20 () {58 vars in 1214 bytes} [Wed Jun 8 02:05:46 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-739347486 => generated 98 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 08 02:05:46.825758 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c7db360d-bc34-47cf-bd57-03d755d58d87 tempest-VolumesNegativeTest-611382554 tempest-VolumesNegativeTest-611382554-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004435 Jun 08 02:05:46.826268 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 34/60] 10.222.0.20 () {58 vars in 1139 bytes} [Wed Jun 8 02:05:46 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 08 02:05:46.836168 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d3041f2e-0886-4c8c-9cd2-bb3ec7ff63f4 tempest-VolumesNegativeTest-611382554 tempest-VolumesNegativeTest-611382554-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004970 Jun 08 02:05:46.836710 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 27/61] 10.222.0.20 () {58 vars in 1136 bytes} [Wed Jun 8 02:05:46 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 08 02:05:46.845680 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0a7c1e25-f0f3-420a-95cf-25aba200328d tempest-VolumesNegativeTest-611382554 tempest-VolumesNegativeTest-611382554-project] Calling method '.version_select at 0x7f83702d44c0>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:46.881134 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-0a7c1e25-f0f3-420a-95cf-25aba200328d tempest-VolumesNegativeTest-611382554 tempest-VolumesNegativeTest-611382554-project] HTTP exception thrown: Volume 2767d9d9-80b1-44d0-ae04-beb406f2b613 could not be found. Jun 08 02:05:46.884887 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0a7c1e25-f0f3-420a-95cf-25aba200328d tempest-VolumesNegativeTest-611382554 tempest-VolumesNegativeTest-611382554-project] Request method failure captured: Jun 08 02:05:46.884887 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: request: DELETE /compute/v2.1/os-volumes/2767d9d9-80b1-44d0-ae04-beb406f2b613 HTTP/1.1 Jun 08 02:05:46.884887 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept: application/json Jun 08 02:05:46.884887 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jun 08 02:05:46.884887 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Connection: close Jun 08 02:05:46.884887 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jun 08 02:05:46.884887 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jun 08 02:05:46.884887 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Host: 10.222.0.20 Jun 08 02:05:46.884887 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jun 08 02:05:46.884887 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jun 08 02:05:46.884887 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABioAP2OuzaKcUOJ0dVNth3LinG6xSfV7EX-KK73FaoM6YWzXWOLMRScbGDTTzbL8ipNCthncMGrAgyAyqO4fR3zh_OlTTyrH4YUx0fltjfldWAKiTA77Puzxha71cDgjn6K3LNzJXPMxC6T_X7rm4ZQD0RG-bZhIInqvz6GgxEQEu-cgk Jun 08 02:05:46.884887 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jun 08 02:05:46.884887 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jun 08 02:05:46.884887 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jun 08 02:05:46.884887 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jun 08 02:05:46.884887 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jun 08 02:05:46.884887 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jun 08 02:05:46.884887 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Id: d0a179fd2abc4e4eae4ecf26761efcc7 Jun 08 02:05:46.884887 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-VolumesNegativeTest-611382554 Jun 08 02:05:46.884887 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jun 08 02:05:46.884887 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jun 08 02:05:46.886059 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0a179fd2abc4e4eae4ecf26761efcc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0a179fd2abc4e4eae4ecf26761efcc7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0a179fd2abc4e4eae4ecf26761efcc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0a179fd2abc4e4eae4ecf26761efcc7"}]}] Jun 08 02:05:46.886059 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-VolumesNegativeTest-611382554 Jun 08 02:05:46.886059 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Id: d0a179fd2abc4e4eae4ecf26761efcc7 Jun 08 02:05:46.886059 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-VolumesNegativeTest-611382554 Jun 08 02:05:46.886059 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User: tempest-VolumesNegativeTest-611382554-project Jun 08 02:05:46.886059 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jun 08 02:05:46.886059 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jun 08 02:05:46.886059 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Id: f3dbf37ddeee414684101d875e763a01 Jun 08 02:05:46.886059 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-VolumesNegativeTest-611382554-project Jun 08 02:05:46.886059 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: method: Jun 08 02:05:46.886059 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: exception: Volume 2767d9d9-80b1-44d0-ae04-beb406f2b613 could not be found. Jun 08 02:05:46.886059 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: action_args: {'id': '2767d9d9-80b1-44d0-ae04-beb406f2b613'} Jun 08 02:05:46.886059 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:05:46.886717 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:46.886717 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 08 02:05:46.886717 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 08 02:05:46.886717 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 08 02:05:46.886717 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 08 02:05:46.886717 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 08 02:05:46.886717 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 08 02:05:46.886717 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 08 02:05:46.886717 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 08 02:05:46.886717 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 08 02:05:46.886717 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 08 02:05:46.886717 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 08 02:05:46.886717 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 08 02:05:46.886717 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 08 02:05:46.886717 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 08 02:05:46.886717 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2767d9d9-80b1-44d0-ae04-beb406f2b613 could not be found. (HTTP 404) (Request-ID: req-70508723-5ec1-454e-bc3f-f7f6051efbd0) Jun 08 02:05:46.886717 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:46.886717 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:05:46.886717 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:46.888593 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:46.888593 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 08 02:05:46.888593 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 08 02:05:46.888593 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 08 02:05:46.888593 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 08 02:05:46.888593 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 08 02:05:46.888593 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 08 02:05:46.888593 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 08 02:05:46.888593 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 08 02:05:46.888593 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 08 02:05:46.888593 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 08 02:05:46.888593 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 08 02:05:46.888593 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 08 02:05:46.888593 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 08 02:05:46.888593 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 08 02:05:46.888593 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 08 02:05:46.888593 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 08 02:05:46.888593 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 08 02:05:46.888593 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 08 02:05:46.889509 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 08 02:05:46.889509 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 08 02:05:46.889509 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 08 02:05:46.889509 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 08 02:05:46.889509 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2767d9d9-80b1-44d0-ae04-beb406f2b613 could not be found. Jun 08 02:05:46.889509 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:46.889509 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:05:46.889509 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:46.889509 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:46.889509 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:05:46.889509 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:05:46.889509 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:05:46.889509 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:05:46.889509 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 08 02:05:46.889509 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 08 02:05:46.889509 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:05:46.889509 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:05:46.889509 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 08 02:05:46.889509 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:05:46.890488 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2767d9d9-80b1-44d0-ae04-beb406f2b613 could not be found. Jun 08 02:05:46.890488 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:46.890488 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:05:46.890488 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:46.890488 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:46.890488 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:05:46.890488 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:05:46.890488 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:05:46.890488 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:05:46.890488 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2767d9d9-80b1-44d0-ae04-beb406f2b613 could not be found. Jun 08 02:05:46.890488 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:05:46.893207 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0a7c1e25-f0f3-420a-95cf-25aba200328d tempest-VolumesNegativeTest-611382554 tempest-VolumesNegativeTest-611382554-project] Returning 404 to user: Volume 2767d9d9-80b1-44d0-ae04-beb406f2b613 could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:05:46.894336 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-0a7c1e25-f0f3-420a-95cf-25aba200328d tempest-VolumesNegativeTest-611382554 tempest-VolumesNegativeTest-611382554-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/2767d9d9-80b1-44d0-ae04-beb406f2b613" status: 404 len: 109 microversion: 2.1 time: 0.052570 Jun 08 02:05:46.895215 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 35/62] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Jun 8 02:05:46 2022] DELETE /compute/v2.1/os-volumes/2767d9d9-80b1-44d0-ae04-beb406f2b613 => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 02:05:46.911173 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b9eb334a-00cb-43e5-afca-edaa63eab587 tempest-VolumesNegativeTest-611382554 tempest-VolumesNegativeTest-611382554-project] Calling method '.version_select at 0x7f83702d6430>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:46.966638 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-b9eb334a-00cb-43e5-afca-edaa63eab587 tempest-VolumesNegativeTest-611382554 tempest-VolumesNegativeTest-611382554-project] HTTP exception thrown: Volume 70902e24-bd6f-49b9-9c9d-ea5d30789a60 could not be found. Jun 08 02:05:46.968640 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b9eb334a-00cb-43e5-afca-edaa63eab587 tempest-VolumesNegativeTest-611382554 tempest-VolumesNegativeTest-611382554-project] Request method failure captured: Jun 08 02:05:46.968640 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/os-volumes/70902e24-bd6f-49b9-9c9d-ea5d30789a60 HTTP/1.1 Jun 08 02:05:46.968640 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept: application/json Jun 08 02:05:46.968640 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jun 08 02:05:46.968640 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Connection: close Jun 08 02:05:46.968640 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jun 08 02:05:46.968640 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jun 08 02:05:46.968640 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Host: 10.222.0.20 Jun 08 02:05:46.968640 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jun 08 02:05:46.968640 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jun 08 02:05:46.968640 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABioAP2OuzaKcUOJ0dVNth3LinG6xSfV7EX-KK73FaoM6YWzXWOLMRScbGDTTzbL8ipNCthncMGrAgyAyqO4fR3zh_OlTTyrH4YUx0fltjfldWAKiTA77Puzxha71cDgjn6K3LNzJXPMxC6T_X7rm4ZQD0RG-bZhIInqvz6GgxEQEu-cgk Jun 08 02:05:46.968640 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jun 08 02:05:46.968640 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jun 08 02:05:46.968640 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jun 08 02:05:46.968640 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jun 08 02:05:46.968640 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jun 08 02:05:46.968640 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jun 08 02:05:46.968640 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Id: d0a179fd2abc4e4eae4ecf26761efcc7 Jun 08 02:05:46.968640 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-VolumesNegativeTest-611382554 Jun 08 02:05:46.968640 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jun 08 02:05:46.968640 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jun 08 02:05:46.970288 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0a179fd2abc4e4eae4ecf26761efcc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0a179fd2abc4e4eae4ecf26761efcc7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0a179fd2abc4e4eae4ecf26761efcc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0a179fd2abc4e4eae4ecf26761efcc7"}]}] Jun 08 02:05:46.970288 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-VolumesNegativeTest-611382554 Jun 08 02:05:46.970288 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Id: d0a179fd2abc4e4eae4ecf26761efcc7 Jun 08 02:05:46.970288 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-VolumesNegativeTest-611382554 Jun 08 02:05:46.970288 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User: tempest-VolumesNegativeTest-611382554-project Jun 08 02:05:46.970288 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jun 08 02:05:46.970288 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jun 08 02:05:46.970288 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Id: f3dbf37ddeee414684101d875e763a01 Jun 08 02:05:46.970288 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-VolumesNegativeTest-611382554-project Jun 08 02:05:46.970288 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: method: Jun 08 02:05:46.970288 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: exception: Volume 70902e24-bd6f-49b9-9c9d-ea5d30789a60 could not be found. Jun 08 02:05:46.970288 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: action_args: {'id': '70902e24-bd6f-49b9-9c9d-ea5d30789a60'} Jun 08 02:05:46.970288 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:05:46.971608 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:46.971608 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 08 02:05:46.971608 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 08 02:05:46.971608 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 08 02:05:46.971608 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 08 02:05:46.971608 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 08 02:05:46.971608 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 08 02:05:46.971608 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 08 02:05:46.971608 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 08 02:05:46.971608 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 08 02:05:46.971608 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 08 02:05:46.971608 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 08 02:05:46.971608 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 08 02:05:46.971608 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 08 02:05:46.971608 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 08 02:05:46.971608 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 70902e24-bd6f-49b9-9c9d-ea5d30789a60 could not be found. (HTTP 404) (Request-ID: req-028b06a4-4eee-41e5-87c5-77f033900a79) Jun 08 02:05:46.971608 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:05:46.971608 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:05:46.971608 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:05:46.975636 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:46.975636 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 08 02:05:46.975636 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 08 02:05:46.975636 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 08 02:05:46.975636 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 08 02:05:46.975636 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 08 02:05:46.975636 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 08 02:05:46.975636 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 08 02:05:46.975636 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 08 02:05:46.975636 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 08 02:05:46.975636 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 08 02:05:46.975636 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 08 02:05:46.975636 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 08 02:05:46.975636 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 08 02:05:46.975636 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 08 02:05:46.975636 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 08 02:05:46.975636 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 08 02:05:46.975636 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 08 02:05:46.975636 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 08 02:05:46.977009 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 08 02:05:46.977009 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 08 02:05:46.977009 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 08 02:05:46.977009 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 08 02:05:46.977009 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 70902e24-bd6f-49b9-9c9d-ea5d30789a60 could not be found. Jun 08 02:05:46.977009 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:05:46.977009 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:05:46.977009 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:05:46.977009 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:46.977009 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:05:46.977009 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:05:46.977009 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:05:46.977009 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:05:46.977009 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 08 02:05:46.977009 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 08 02:05:46.977009 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:05:46.977009 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:05:46.977009 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 08 02:05:46.977009 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:05:46.978150 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 70902e24-bd6f-49b9-9c9d-ea5d30789a60 could not be found. Jun 08 02:05:46.978150 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:05:46.978150 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:05:46.978150 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:05:46.978150 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:05:46.978150 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:05:46.978150 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:05:46.978150 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:05:46.978150 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:05:46.978150 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 70902e24-bd6f-49b9-9c9d-ea5d30789a60 could not be found. Jun 08 02:05:46.978150 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:05:46.978150 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b9eb334a-00cb-43e5-afca-edaa63eab587 tempest-VolumesNegativeTest-611382554 tempest-VolumesNegativeTest-611382554-project] Returning 404 to user: Volume 70902e24-bd6f-49b9-9c9d-ea5d30789a60 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:05:46.978150 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b9eb334a-00cb-43e5-afca-edaa63eab587 tempest-VolumesNegativeTest-611382554 tempest-VolumesNegativeTest-611382554-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/70902e24-bd6f-49b9-9c9d-ea5d30789a60" status: 404 len: 109 microversion: 2.1 time: 0.069632 Jun 08 02:05:46.984736 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 28/63] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jun 8 02:05:46 2022] GET /compute/v2.1/os-volumes/70902e24-bd6f-49b9-9c9d-ea5d30789a60 => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 02:05:47.620029 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-14919535-2cc2-4b51-8619-fb228e3fcda8 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:47.622213 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-14919535-2cc2-4b51-8619-fb228e3fcda8 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:47.631024 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-14919535-2cc2-4b51-8619-fb228e3fcda8 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:47.631488 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-14919535-2cc2-4b51-8619-fb228e3fcda8 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:47.632273 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-14919535-2cc2-4b51-8619-fb228e3fcda8 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:47.632900 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-14919535-2cc2-4b51-8619-fb228e3fcda8 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:47.785365 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4ce92cd7-8de2-4bb5-bd52-fc9e943e05c5 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:47.785365 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4ce92cd7-8de2-4bb5-bd52-fc9e943e05c5 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:47.804321 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4ce92cd7-8de2-4bb5-bd52-fc9e943e05c5 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:47.804918 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4ce92cd7-8de2-4bb5-bd52-fc9e943e05c5 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:47.805586 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4ce92cd7-8de2-4bb5-bd52-fc9e943e05c5 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:47.806023 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4ce92cd7-8de2-4bb5-bd52-fc9e943e05c5 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:47.813751 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-14919535-2cc2-4b51-8619-fb228e3fcda8 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee50293b204bedb1ea03d77b940514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b90d01b80e450b9357d02c245c9531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:47.822250 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-14919535-2cc2-4b51-8619-fb228e3fcda8 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475" status: 200 len: 1315 microversion: 2.1 time: 0.207200 Jun 08 02:05:47.823015 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 36/64] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:47 2022] GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:05:47.827791 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a694d07d-3939-4785-94da-c24b07a54b33 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:47.828347 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a694d07d-3939-4785-94da-c24b07a54b33 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:47.835066 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a694d07d-3939-4785-94da-c24b07a54b33 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:47.836135 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a694d07d-3939-4785-94da-c24b07a54b33 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:47.837461 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a694d07d-3939-4785-94da-c24b07a54b33 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:47.838373 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a694d07d-3939-4785-94da-c24b07a54b33 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:47.946100 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a694d07d-3939-4785-94da-c24b07a54b33 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:47.947243 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4ce92cd7-8de2-4bb5-bd52-fc9e943e05c5 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:47.955241 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a694d07d-3939-4785-94da-c24b07a54b33 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1240 microversion: 2.1 time: 0.130734 Jun 08 02:05:47.956287 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4ce92cd7-8de2-4bb5-bd52-fc9e943e05c5 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1226 microversion: 2.1 time: 0.177054 Jun 08 02:05:47.960515 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 29/65] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:47 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1226 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:05:47.967598 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 37/66] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:47 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1240 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:05:48.846859 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-88e62021-81d3-41ae-936b-ec9f0d79eb91 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:48.847486 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-88e62021-81d3-41ae-936b-ec9f0d79eb91 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:48.873120 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-88e62021-81d3-41ae-936b-ec9f0d79eb91 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:48.878747 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-88e62021-81d3-41ae-936b-ec9f0d79eb91 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:48.880095 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-88e62021-81d3-41ae-936b-ec9f0d79eb91 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:48.881685 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-88e62021-81d3-41ae-936b-ec9f0d79eb91 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:48.973709 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-253f975e-bd23-4cd2-8c80-6d05aedd39d9 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:48.975914 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-253f975e-bd23-4cd2-8c80-6d05aedd39d9 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:49.003101 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-253f975e-bd23-4cd2-8c80-6d05aedd39d9 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:49.003746 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-253f975e-bd23-4cd2-8c80-6d05aedd39d9 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:49.007109 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-253f975e-bd23-4cd2-8c80-6d05aedd39d9 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:49.008835 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-253f975e-bd23-4cd2-8c80-6d05aedd39d9 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:49.488369 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-253f975e-bd23-4cd2-8c80-6d05aedd39d9 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:49.506365 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-253f975e-bd23-4cd2-8c80-6d05aedd39d9 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1232 microversion: 2.1 time: 0.536767 Jun 08 02:05:49.507559 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 38/67] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:48 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1232 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:05:49.515274 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e5be3404-1f6d-462b-8cee-00e2b33b4e40 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:49.516152 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e5be3404-1f6d-462b-8cee-00e2b33b4e40 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:49.528709 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e5be3404-1f6d-462b-8cee-00e2b33b4e40 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:49.529701 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e5be3404-1f6d-462b-8cee-00e2b33b4e40 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:49.531473 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e5be3404-1f6d-462b-8cee-00e2b33b4e40 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:49.532456 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e5be3404-1f6d-462b-8cee-00e2b33b4e40 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:49.609365 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-88e62021-81d3-41ae-936b-ec9f0d79eb91 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee50293b204bedb1ea03d77b940514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b90d01b80e450b9357d02c245c9531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:49.619239 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=41 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:05:49.626739 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-88e62021-81d3-41ae-936b-ec9f0d79eb91 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475" status: 200 len: 1315 microversion: 2.1 time: 0.788063 Jun 08 02:05:49.628869 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 30/68] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:48 2022] GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 => generated 1315 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:05:49.646783 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e5be3404-1f6d-462b-8cee-00e2b33b4e40 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:49.654486 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e5be3404-1f6d-462b-8cee-00e2b33b4e40 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1274 microversion: 2.1 time: 0.145628 Jun 08 02:05:49.655050 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 39/69] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:49 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1274 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:05:50.527132 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f599e0d4-8f75-47f2-93d4-45747dc3c6d4 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:50.528301 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f599e0d4-8f75-47f2-93d4-45747dc3c6d4 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:50.537035 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=10 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:05:50.539355 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f599e0d4-8f75-47f2-93d4-45747dc3c6d4 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:50.539963 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f599e0d4-8f75-47f2-93d4-45747dc3c6d4 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:50.541666 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f599e0d4-8f75-47f2-93d4-45747dc3c6d4 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:50.542265 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f599e0d4-8f75-47f2-93d4-45747dc3c6d4 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:50.612672 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f599e0d4-8f75-47f2-93d4-45747dc3c6d4 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:50.621639 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f599e0d4-8f75-47f2-93d4-45747dc3c6d4 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1296 microversion: 2.1 time: 0.100738 Jun 08 02:05:50.622489 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 31/70] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:50 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1296 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:05:50.653065 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ecf4c830-0f19-4134-bc9a-3105865ef645 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:50.653681 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ecf4c830-0f19-4134-bc9a-3105865ef645 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:50.662315 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ecf4c830-0f19-4134-bc9a-3105865ef645 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:50.663264 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ecf4c830-0f19-4134-bc9a-3105865ef645 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:50.664562 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ecf4c830-0f19-4134-bc9a-3105865ef645 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:50.665335 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ecf4c830-0f19-4134-bc9a-3105865ef645 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:50.678925 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0037018c-3d84-4bef-9a09-c29c68d41cfe tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:50.679846 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0037018c-3d84-4bef-9a09-c29c68d41cfe tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:50.689431 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0037018c-3d84-4bef-9a09-c29c68d41cfe tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:50.690435 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0037018c-3d84-4bef-9a09-c29c68d41cfe tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:50.691674 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0037018c-3d84-4bef-9a09-c29c68d41cfe tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:50.692377 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0037018c-3d84-4bef-9a09-c29c68d41cfe tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:50.899771 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0037018c-3d84-4bef-9a09-c29c68d41cfe tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:50.909957 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0037018c-3d84-4bef-9a09-c29c68d41cfe tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1282 microversion: 2.1 time: 0.240252 Jun 08 02:05:50.922633 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 32/71] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:50 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1282 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:05:50.982887 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ecf4c830-0f19-4134-bc9a-3105865ef645 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee50293b204bedb1ea03d77b940514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b90d01b80e450b9357d02c245c9531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:50.993933 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ecf4c830-0f19-4134-bc9a-3105865ef645 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475" status: 200 len: 1315 microversion: 2.1 time: 0.345718 Jun 08 02:05:50.994526 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 40/72] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:50 2022] GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:05:51.638804 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-eddc14b6-2ba0-4639-8760-1042ad71d5a9 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:51.639432 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-eddc14b6-2ba0-4639-8760-1042ad71d5a9 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:51.652057 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eddc14b6-2ba0-4639-8760-1042ad71d5a9 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:51.652714 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eddc14b6-2ba0-4639-8760-1042ad71d5a9 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:51.654852 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eddc14b6-2ba0-4639-8760-1042ad71d5a9 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:51.656178 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eddc14b6-2ba0-4639-8760-1042ad71d5a9 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:51.820959 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-eddc14b6-2ba0-4639-8760-1042ad71d5a9 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:51.833330 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-eddc14b6-2ba0-4639-8760-1042ad71d5a9 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1294 microversion: 2.1 time: 0.195624 Jun 08 02:05:51.836920 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 33/73] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:51 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1294 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:05:51.930447 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-38e5c47b-3cb3-489e-b18b-33f0aa61dced tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:51.931064 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-38e5c47b-3cb3-489e-b18b-33f0aa61dced tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:51.933141 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:05:51.948956 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-38e5c47b-3cb3-489e-b18b-33f0aa61dced tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:51.950129 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-38e5c47b-3cb3-489e-b18b-33f0aa61dced tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:51.950995 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-38e5c47b-3cb3-489e-b18b-33f0aa61dced tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:51.951442 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-38e5c47b-3cb3-489e-b18b-33f0aa61dced tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:51.961745 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=79 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:05:52.012112 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-98e55a9a-fee1-4ca3-8248-d89d5318f6e5 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:52.012777 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-98e55a9a-fee1-4ca3-8248-d89d5318f6e5 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:52.022707 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-98e55a9a-fee1-4ca3-8248-d89d5318f6e5 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:52.024688 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-98e55a9a-fee1-4ca3-8248-d89d5318f6e5 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:52.028573 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-98e55a9a-fee1-4ca3-8248-d89d5318f6e5 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:52.029271 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-98e55a9a-fee1-4ca3-8248-d89d5318f6e5 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:52.097500 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-38e5c47b-3cb3-489e-b18b-33f0aa61dced tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:52.106788 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-38e5c47b-3cb3-489e-b18b-33f0aa61dced tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1280 microversion: 2.1 time: 0.181118 Jun 08 02:05:52.109814 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 41/74] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:51 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1280 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:05:52.445056 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-98e55a9a-fee1-4ca3-8248-d89d5318f6e5 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee50293b204bedb1ea03d77b940514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b90d01b80e450b9357d02c245c9531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:52.454512 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-98e55a9a-fee1-4ca3-8248-d89d5318f6e5 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475" status: 200 len: 1315 microversion: 2.1 time: 0.446779 Jun 08 02:05:52.455204 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 34/75] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:52 2022] GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:05:52.855000 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-cebdf693-d76c-48cc-9a38-69d28570d8cf tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:52.855618 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-cebdf693-d76c-48cc-9a38-69d28570d8cf tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:52.868229 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cebdf693-d76c-48cc-9a38-69d28570d8cf tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:52.875126 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cebdf693-d76c-48cc-9a38-69d28570d8cf tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:52.876023 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cebdf693-d76c-48cc-9a38-69d28570d8cf tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:52.876522 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cebdf693-d76c-48cc-9a38-69d28570d8cf tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:53.125953 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-af0a8fec-1804-4da9-a56d-ff58a15708df tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:53.127129 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-af0a8fec-1804-4da9-a56d-ff58a15708df tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:53.141458 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-af0a8fec-1804-4da9-a56d-ff58a15708df tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:53.141918 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-af0a8fec-1804-4da9-a56d-ff58a15708df tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:53.142693 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-af0a8fec-1804-4da9-a56d-ff58a15708df tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:53.143126 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-af0a8fec-1804-4da9-a56d-ff58a15708df tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:53.341214 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-af0a8fec-1804-4da9-a56d-ff58a15708df tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:53.354815 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-cebdf693-d76c-48cc-9a38-69d28570d8cf tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:53.370476 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-cebdf693-d76c-48cc-9a38-69d28570d8cf tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1361 microversion: 2.1 time: 0.514578 Jun 08 02:05:53.372753 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-af0a8fec-1804-4da9-a56d-ff58a15708df tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1280 microversion: 2.1 time: 0.249959 Jun 08 02:05:53.373677 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 42/76] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:52 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1361 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:05:53.376144 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 35/77] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:53 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1280 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:05:53.475796 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e9dec901-1d55-4eb1-b853-3c39f334ad61 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:53.476946 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e9dec901-1d55-4eb1-b853-3c39f334ad61 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:53.504177 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e9dec901-1d55-4eb1-b853-3c39f334ad61 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:53.504576 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e9dec901-1d55-4eb1-b853-3c39f334ad61 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:53.505716 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e9dec901-1d55-4eb1-b853-3c39f334ad61 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:53.507921 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e9dec901-1d55-4eb1-b853-3c39f334ad61 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:53.771555 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e9dec901-1d55-4eb1-b853-3c39f334ad61 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee50293b204bedb1ea03d77b940514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b90d01b80e450b9357d02c245c9531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:53.781808 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e9dec901-1d55-4eb1-b853-3c39f334ad61 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475" status: 200 len: 1315 microversion: 2.1 time: 0.311446 Jun 08 02:05:53.784828 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 43/78] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:53 2022] GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:05:54.000892 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-345fa591-e4fa-4a24-b562-c89eba099ef6 req-ea46eb65-5f47-4d32-908c-8308ab50b349 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4fe47a1-fdef-478e-94c7-42b5945a57ae", "tag": "895ce244-87ef-415a-88d2-f764d9932c90"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:05:54.017470 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-345fa591-e4fa-4a24-b562-c89eba099ef6 req-ea46eb65-5f47-4d32-908c-8308ab50b349 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:54.018242 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-345fa591-e4fa-4a24-b562-c89eba099ef6 req-ea46eb65-5f47-4d32-908c-8308ab50b349 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:54.043989 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-345fa591-e4fa-4a24-b562-c89eba099ef6 req-ea46eb65-5f47-4d32-908c-8308ab50b349 service nova] Creating event network-changed:895ce244-87ef-415a-88d2-f764d9932c90 for instance f4fe47a1-fdef-478e-94c7-42b5945a57ae on hv-cinder-84506 Jun 08 02:05:54.044704 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-345fa591-e4fa-4a24-b562-c89eba099ef6 req-ea46eb65-5f47-4d32-908c-8308ab50b349 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117938) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 08 02:05:54.046369 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cad4c099-abe4-4a54-8ecc-6a16b5640ef4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:54.046969 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cad4c099-abe4-4a54-8ecc-6a16b5640ef4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:54.047896 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cad4c099-abe4-4a54-8ecc-6a16b5640ef4 None None] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:54.048597 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cad4c099-abe4-4a54-8ecc-6a16b5640ef4 None None] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:54.058790 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.compute.rpcapi [None req-cad4c099-abe4-4a54-8ecc-6a16b5640ef4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 08 02:05:54.059951 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cad4c099-abe4-4a54-8ecc-6a16b5640ef4 None None] Releasing lock "compute-rpcapi-router" {{(pid=117938) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 08 02:05:54.101869 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-cad4c099-abe4-4a54-8ecc-6a16b5640ef4 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.329302 Jun 08 02:05:54.107785 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 36/79] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:05:54.392606 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f25cefd3-aa31-40a7-9999-1ca64a6132ab tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:54.394098 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f25cefd3-aa31-40a7-9999-1ca64a6132ab tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:54.400803 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ce98d76e-7088-47fb-81a6-1c35ab14e5d6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:54.401974 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f25cefd3-aa31-40a7-9999-1ca64a6132ab tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:54.402585 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f25cefd3-aa31-40a7-9999-1ca64a6132ab tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:54.403130 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ce98d76e-7088-47fb-81a6-1c35ab14e5d6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:54.403587 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f25cefd3-aa31-40a7-9999-1ca64a6132ab tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:54.403811 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f25cefd3-aa31-40a7-9999-1ca64a6132ab tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:54.413251 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ce98d76e-7088-47fb-81a6-1c35ab14e5d6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:54.413692 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ce98d76e-7088-47fb-81a6-1c35ab14e5d6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:54.414618 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ce98d76e-7088-47fb-81a6-1c35ab14e5d6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:54.415234 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ce98d76e-7088-47fb-81a6-1c35ab14e5d6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:54.627619 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f25cefd3-aa31-40a7-9999-1ca64a6132ab tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:54.629357 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ce98d76e-7088-47fb-81a6-1c35ab14e5d6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:54.642404 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f25cefd3-aa31-40a7-9999-1ca64a6132ab tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1361 microversion: 2.1 time: 0.255227 Jun 08 02:05:54.642978 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 44/80] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:54 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1361 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:05:54.654592 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ce98d76e-7088-47fb-81a6-1c35ab14e5d6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1322 microversion: 2.1 time: 0.259042 Jun 08 02:05:54.655172 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 37/81] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:54 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:05:54.803173 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-9fc3b24c-c457-4730-bacf-6e53f513da91 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:54.804052 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-9fc3b24c-c457-4730-bacf-6e53f513da91 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:54.810937 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9fc3b24c-c457-4730-bacf-6e53f513da91 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:54.811381 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9fc3b24c-c457-4730-bacf-6e53f513da91 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:54.812200 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9fc3b24c-c457-4730-bacf-6e53f513da91 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:54.812661 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9fc3b24c-c457-4730-bacf-6e53f513da91 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:54.968561 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-9fc3b24c-c457-4730-bacf-6e53f513da91 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee50293b204bedb1ea03d77b940514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b90d01b80e450b9357d02c245c9531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:54.975258 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-9fc3b24c-c457-4730-bacf-6e53f513da91 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475" status: 200 len: 1315 microversion: 2.1 time: 0.177655 Jun 08 02:05:54.975923 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 45/82] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:54 2022] GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:05:55.665611 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-68494026-2469-44df-90ba-371d1d7574ca tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:55.667198 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-68494026-2469-44df-90ba-371d1d7574ca tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:55.675229 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-4bc584c7-6535-4b95-aaa8-ae68adfc57a8 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:55.676864 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-4bc584c7-6535-4b95-aaa8-ae68adfc57a8 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:55.696634 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4bc584c7-6535-4b95-aaa8-ae68adfc57a8 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:55.698106 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-68494026-2469-44df-90ba-371d1d7574ca tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:55.698614 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4bc584c7-6535-4b95-aaa8-ae68adfc57a8 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:55.701596 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-68494026-2469-44df-90ba-371d1d7574ca tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:55.702625 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4bc584c7-6535-4b95-aaa8-ae68adfc57a8 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:55.704136 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-68494026-2469-44df-90ba-371d1d7574ca tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:55.704947 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4bc584c7-6535-4b95-aaa8-ae68adfc57a8 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:55.710885 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-68494026-2469-44df-90ba-371d1d7574ca tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:56.184736 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=24 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:05:56.283198 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-68494026-2469-44df-90ba-371d1d7574ca tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:56.296148 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-68494026-2469-44df-90ba-371d1d7574ca tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1361 microversion: 2.1 time: 0.639043 Jun 08 02:05:56.301023 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 38/83] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:55 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1361 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:05:56.314178 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c8440cca-bf0a-4e8f-9771-517f89de2a96 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:56.314795 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c8440cca-bf0a-4e8f-9771-517f89de2a96 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:56.321896 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c8440cca-bf0a-4e8f-9771-517f89de2a96 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:56.322529 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c8440cca-bf0a-4e8f-9771-517f89de2a96 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:56.323098 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c8440cca-bf0a-4e8f-9771-517f89de2a96 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:56.323593 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c8440cca-bf0a-4e8f-9771-517f89de2a96 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:56.361787 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-4bc584c7-6535-4b95-aaa8-ae68adfc57a8 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:56.372446 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-4bc584c7-6535-4b95-aaa8-ae68adfc57a8 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1322 microversion: 2.1 time: 0.703089 Jun 08 02:05:56.373216 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 46/84] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:55 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1322 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:05:56.734562 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c8440cca-bf0a-4e8f-9771-517f89de2a96 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee50293b204bedb1ea03d77b940514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b90d01b80e450b9357d02c245c9531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:56.751124 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c8440cca-bf0a-4e8f-9771-517f89de2a96 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475" status: 200 len: 1315 microversion: 2.1 time: 0.448989 Jun 08 02:05:56.751715 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 39/85] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:56 2022] GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 => generated 1315 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:05:57.319284 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f154fb0f-c368-431e-bd58-5847b22e0fda tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:57.319903 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f154fb0f-c368-431e-bd58-5847b22e0fda tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:57.321813 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=4 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:05:57.322467 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=10 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:05:57.334968 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f154fb0f-c368-431e-bd58-5847b22e0fda tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:57.338036 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f154fb0f-c368-431e-bd58-5847b22e0fda tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:57.338986 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f154fb0f-c368-431e-bd58-5847b22e0fda tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:57.348360 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f154fb0f-c368-431e-bd58-5847b22e0fda tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:57.390982 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8cb7d248-ca1c-4d55-8a60-ef7404d96b73 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:57.391732 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8cb7d248-ca1c-4d55-8a60-ef7404d96b73 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:57.405092 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8cb7d248-ca1c-4d55-8a60-ef7404d96b73 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:57.405535 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8cb7d248-ca1c-4d55-8a60-ef7404d96b73 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:57.406306 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8cb7d248-ca1c-4d55-8a60-ef7404d96b73 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:57.406739 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8cb7d248-ca1c-4d55-8a60-ef7404d96b73 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:57.936237 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f154fb0f-c368-431e-bd58-5847b22e0fda tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:57.944825 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f154fb0f-c368-431e-bd58-5847b22e0fda tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1361 microversion: 2.1 time: 0.630169 Jun 08 02:05:57.945447 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 47/86] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:57 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1361 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:05:57.971258 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-7d5d2f34-0456-4107-9344-688815950caf req-fe112244-2cbb-4b97-88ff-7ff088b35f42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb925141-6220-42fb-acfe-098906d06f8b", "tag": "854f4972-75d1-4f33-b863-4ac1e9184f71"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:05:57.998871 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-7d5d2f34-0456-4107-9344-688815950caf req-fe112244-2cbb-4b97-88ff-7ff088b35f42 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:57.999476 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-7d5d2f34-0456-4107-9344-688815950caf req-fe112244-2cbb-4b97-88ff-7ff088b35f42 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:58.023571 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-7d5d2f34-0456-4107-9344-688815950caf req-fe112244-2cbb-4b97-88ff-7ff088b35f42 service nova] Creating event network-changed:854f4972-75d1-4f33-b863-4ac1e9184f71 for instance eb925141-6220-42fb-acfe-098906d06f8b on hv-cinder-84506 Jun 08 02:05:58.033420 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-7d5d2f34-0456-4107-9344-688815950caf req-fe112244-2cbb-4b97-88ff-7ff088b35f42 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069308 Jun 08 02:05:58.040966 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 48/87] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:05:58.057024 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-aab7ce70-0867-44a8-8dca-a6fa4964696b tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:58.059362 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-aab7ce70-0867-44a8-8dca-a6fa4964696b tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:58.073155 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-aab7ce70-0867-44a8-8dca-a6fa4964696b tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:58.074431 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-aab7ce70-0867-44a8-8dca-a6fa4964696b tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:58.077040 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-aab7ce70-0867-44a8-8dca-a6fa4964696b tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:58.080173 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-aab7ce70-0867-44a8-8dca-a6fa4964696b tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:58.326276 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8cb7d248-ca1c-4d55-8a60-ef7404d96b73 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:58.340261 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8cb7d248-ca1c-4d55-8a60-ef7404d96b73 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1322 microversion: 2.1 time: 0.953384 Jun 08 02:05:58.342541 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 40/88] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:57 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1322 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:05:58.350425 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-13230af3-a0c0-4899-8142-e50073577bbb req-beacacae-b12d-4b01-af65-1ef44fa2b018 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b508446f-daa7-46a1-be64-fd8528cfa380", "tag": "f15849eb-1bf4-44c4-8575-7be145474d94"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:05:58.362597 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-13230af3-a0c0-4899-8142-e50073577bbb req-beacacae-b12d-4b01-af65-1ef44fa2b018 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:58.363272 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-13230af3-a0c0-4899-8142-e50073577bbb req-beacacae-b12d-4b01-af65-1ef44fa2b018 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:58.380791 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-13230af3-a0c0-4899-8142-e50073577bbb req-beacacae-b12d-4b01-af65-1ef44fa2b018 service nova] Creating event network-changed:f15849eb-1bf4-44c4-8575-7be145474d94 for instance b508446f-daa7-46a1-be64-fd8528cfa380 on hv-cinder-84506 Jun 08 02:05:58.386448 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-13230af3-a0c0-4899-8142-e50073577bbb req-beacacae-b12d-4b01-af65-1ef44fa2b018 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042130 Jun 08 02:05:58.387282 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 41/89] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:05:58.636052 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-4faf8453-7f14-49af-b96a-5b956d04c0d5 req-4a54525d-d9ef-401a-89ff-efcd3534c6a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "400093fe-afb9-4690-9da0-e7a6c7103475", "name": "network-vif-plugged", "status": "completed", "tag": "732d068c-f7fd-41f4-8c10-2743ccfb57c5"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:05:58.650531 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-4faf8453-7f14-49af-b96a-5b956d04c0d5 req-4a54525d-d9ef-401a-89ff-efcd3534c6a5 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:58.652064 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-4faf8453-7f14-49af-b96a-5b956d04c0d5 req-4a54525d-d9ef-401a-89ff-efcd3534c6a5 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:58.669145 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-4faf8453-7f14-49af-b96a-5b956d04c0d5 req-4a54525d-d9ef-401a-89ff-efcd3534c6a5 service nova] Creating event network-vif-plugged:732d068c-f7fd-41f4-8c10-2743ccfb57c5 for instance 400093fe-afb9-4690-9da0-e7a6c7103475 on hv-cinder-84506 Jun 08 02:05:58.677775 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-4faf8453-7f14-49af-b96a-5b956d04c0d5 req-4a54525d-d9ef-401a-89ff-efcd3534c6a5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.287645 Jun 08 02:05:58.678443 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 42/90] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:05:58.743484 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-aab7ce70-0867-44a8-8dca-a6fa4964696b tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee50293b204bedb1ea03d77b940514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b90d01b80e450b9357d02c245c9531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:58.751611 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-aab7ce70-0867-44a8-8dca-a6fa4964696b tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475" status: 200 len: 1315 microversion: 2.1 time: 0.708476 Jun 08 02:05:58.774545 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 49/91] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:58 2022] GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 => generated 1315 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:05:58.963863 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-734b5419-e1cd-4609-9d65-3497ada8e6d5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:58.964605 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-734b5419-e1cd-4609-9d65-3497ada8e6d5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:58.971285 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-734b5419-e1cd-4609-9d65-3497ada8e6d5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:58.972266 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-734b5419-e1cd-4609-9d65-3497ada8e6d5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:58.973212 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-734b5419-e1cd-4609-9d65-3497ada8e6d5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:58.974376 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-734b5419-e1cd-4609-9d65-3497ada8e6d5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:59.360484 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-5e8e8f9f-1a00-460d-8bbe-3a7698f5137f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:59.362218 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-5e8e8f9f-1a00-460d-8bbe-3a7698f5137f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:59.380166 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5e8e8f9f-1a00-460d-8bbe-3a7698f5137f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:59.380690 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5e8e8f9f-1a00-460d-8bbe-3a7698f5137f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:59.381413 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5e8e8f9f-1a00-460d-8bbe-3a7698f5137f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:59.388650 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5e8e8f9f-1a00-460d-8bbe-3a7698f5137f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:59.516241 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-734b5419-e1cd-4609-9d65-3497ada8e6d5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:59.529187 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-734b5419-e1cd-4609-9d65-3497ada8e6d5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1361 microversion: 2.1 time: 0.569206 Jun 08 02:05:59.531450 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 43/92] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:58 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1361 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:05:59.781584 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7c9cc845-f844-48e7-b952-e32eaeaf8969 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:05:59.782197 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7c9cc845-f844-48e7-b952-e32eaeaf8969 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:05:59.791573 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7c9cc845-f844-48e7-b952-e32eaeaf8969 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:59.792022 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7c9cc845-f844-48e7-b952-e32eaeaf8969 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:59.792814 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7c9cc845-f844-48e7-b952-e32eaeaf8969 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:05:59.793242 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7c9cc845-f844-48e7-b952-e32eaeaf8969 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:05:59.941265 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-5e8e8f9f-1a00-460d-8bbe-3a7698f5137f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:05:59.962079 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-5e8e8f9f-1a00-460d-8bbe-3a7698f5137f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1322 microversion: 2.1 time: 0.607358 Jun 08 02:05:59.963105 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 50/93] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:59 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1322 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:00.289371 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7c9cc845-f844-48e7-b952-e32eaeaf8969 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee50293b204bedb1ea03d77b940514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b90d01b80e450b9357d02c245c9531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:00.311703 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7c9cc845-f844-48e7-b952-e32eaeaf8969 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475" status: 200 len: 1315 microversion: 2.1 time: 0.532872 Jun 08 02:06:00.312546 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 44/94] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:05:59 2022] GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 => generated 1315 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:06:00.547199 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a0865068-d07a-4f3b-a686-3896ecc73df5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:00.547801 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a0865068-d07a-4f3b-a686-3896ecc73df5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:00.554344 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a0865068-d07a-4f3b-a686-3896ecc73df5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:00.554978 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a0865068-d07a-4f3b-a686-3896ecc73df5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:00.555772 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a0865068-d07a-4f3b-a686-3896ecc73df5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:00.556247 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a0865068-d07a-4f3b-a686-3896ecc73df5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:00.744735 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a0865068-d07a-4f3b-a686-3896ecc73df5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:00.758130 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a0865068-d07a-4f3b-a686-3896ecc73df5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1361 microversion: 2.1 time: 0.213461 Jun 08 02:06:00.759610 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 51/95] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:00 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1361 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:00.953017 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-73dc6011-e205-4cd7-bb72-05338b3868dd req-581df931-31c7-43f7-a733-1eace960cc0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4fe47a1-fdef-478e-94c7-42b5945a57ae", "name": "network-vif-plugged", "status": "completed", "tag": "895ce244-87ef-415a-88d2-f764d9932c90"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:06:00.974511 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-73dc6011-e205-4cd7-bb72-05338b3868dd req-581df931-31c7-43f7-a733-1eace960cc0d service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:00.981253 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-386083d0-89d5-493c-b035-685d0e301381 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:00.985370 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-73dc6011-e205-4cd7-bb72-05338b3868dd req-581df931-31c7-43f7-a733-1eace960cc0d service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:00.985862 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-386083d0-89d5-493c-b035-685d0e301381 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:00.997230 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-386083d0-89d5-493c-b035-685d0e301381 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:00.997736 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-386083d0-89d5-493c-b035-685d0e301381 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:00.998621 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-386083d0-89d5-493c-b035-685d0e301381 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:01.005619 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-73dc6011-e205-4cd7-bb72-05338b3868dd req-581df931-31c7-43f7-a733-1eace960cc0d service nova] Creating event network-vif-plugged:895ce244-87ef-415a-88d2-f764d9932c90 for instance f4fe47a1-fdef-478e-94c7-42b5945a57ae on hv-cinder-84506 Jun 08 02:06:01.007759 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-386083d0-89d5-493c-b035-685d0e301381 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:01.011400 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-73dc6011-e205-4cd7-bb72-05338b3868dd req-581df931-31c7-43f7-a733-1eace960cc0d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063238 Jun 08 02:06:01.012548 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 45/96] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 02:06:01.221674 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-386083d0-89d5-493c-b035-685d0e301381 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:01.232095 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-386083d0-89d5-493c-b035-685d0e301381 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1322 microversion: 2.1 time: 0.255921 Jun 08 02:06:01.233086 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 52/97] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:00 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1322 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:01.331028 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f040edae-b3fa-4fe8-88e5-f5a1426df17c tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:01.331983 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f040edae-b3fa-4fe8-88e5-f5a1426df17c tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:01.343600 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f040edae-b3fa-4fe8-88e5-f5a1426df17c tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:01.344509 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f040edae-b3fa-4fe8-88e5-f5a1426df17c tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:01.345615 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f040edae-b3fa-4fe8-88e5-f5a1426df17c tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:01.346223 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f040edae-b3fa-4fe8-88e5-f5a1426df17c tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:01.601791 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f040edae-b3fa-4fe8-88e5-f5a1426df17c tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee50293b204bedb1ea03d77b940514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b90d01b80e450b9357d02c245c9531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:01.612590 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f040edae-b3fa-4fe8-88e5-f5a1426df17c tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475" status: 200 len: 1315 microversion: 2.1 time: 0.286275 Jun 08 02:06:01.614596 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 46/98] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:01 2022] GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:01.775688 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-65f460d3-fbea-40d4-adbf-66ccd08fd04f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:01.776701 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-65f460d3-fbea-40d4-adbf-66ccd08fd04f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:01.791169 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-65f460d3-fbea-40d4-adbf-66ccd08fd04f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:01.791965 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-65f460d3-fbea-40d4-adbf-66ccd08fd04f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:01.793142 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-65f460d3-fbea-40d4-adbf-66ccd08fd04f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:01.793725 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-65f460d3-fbea-40d4-adbf-66ccd08fd04f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:02.224056 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-65f460d3-fbea-40d4-adbf-66ccd08fd04f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:02.231581 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-65f460d3-fbea-40d4-adbf-66ccd08fd04f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1361 microversion: 2.1 time: 0.459830 Jun 08 02:06:02.240658 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 53/99] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:01 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1361 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:02.248833 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ba51d66a-606d-4ead-91ba-6b806ce5c4b4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:02.250002 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ba51d66a-606d-4ead-91ba-6b806ce5c4b4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:02.256069 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ba51d66a-606d-4ead-91ba-6b806ce5c4b4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:02.256558 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ba51d66a-606d-4ead-91ba-6b806ce5c4b4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:02.257328 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ba51d66a-606d-4ead-91ba-6b806ce5c4b4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:02.257759 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ba51d66a-606d-4ead-91ba-6b806ce5c4b4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:02.464978 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ba51d66a-606d-4ead-91ba-6b806ce5c4b4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:02.476776 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ba51d66a-606d-4ead-91ba-6b806ce5c4b4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1322 microversion: 2.1 time: 0.231438 Jun 08 02:06:02.478207 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 47/100] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:02 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:02.631373 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-efd8ffe4-e52b-4e7a-9ef9-59597cb2d8b6 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:02.631373 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-efd8ffe4-e52b-4e7a-9ef9-59597cb2d8b6 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:02.637165 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-efd8ffe4-e52b-4e7a-9ef9-59597cb2d8b6 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:02.637614 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-efd8ffe4-e52b-4e7a-9ef9-59597cb2d8b6 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:02.638382 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-efd8ffe4-e52b-4e7a-9ef9-59597cb2d8b6 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:02.638809 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-efd8ffe4-e52b-4e7a-9ef9-59597cb2d8b6 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:02.820664 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-efd8ffe4-e52b-4e7a-9ef9-59597cb2d8b6 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee50293b204bedb1ea03d77b940514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b90d01b80e450b9357d02c245c9531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:02.830025 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-efd8ffe4-e52b-4e7a-9ef9-59597cb2d8b6 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475" status: 200 len: 1315 microversion: 2.1 time: 0.203794 Jun 08 02:06:02.830684 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 54/101] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:02 2022] GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:03.249434 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8b8151ca-1d0a-4062-923b-38f551fb3903 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:03.250593 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8b8151ca-1d0a-4062-923b-38f551fb3903 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:03.258123 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8b8151ca-1d0a-4062-923b-38f551fb3903 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:03.258824 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8b8151ca-1d0a-4062-923b-38f551fb3903 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:03.259979 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8b8151ca-1d0a-4062-923b-38f551fb3903 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:03.260578 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8b8151ca-1d0a-4062-923b-38f551fb3903 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:03.495948 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-1cf67ec3-5aab-4821-98cc-4b0afe9b34d5 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:03.496726 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-1cf67ec3-5aab-4821-98cc-4b0afe9b34d5 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:03.503584 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1cf67ec3-5aab-4821-98cc-4b0afe9b34d5 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:03.504243 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1cf67ec3-5aab-4821-98cc-4b0afe9b34d5 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:03.505408 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1cf67ec3-5aab-4821-98cc-4b0afe9b34d5 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:03.506009 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1cf67ec3-5aab-4821-98cc-4b0afe9b34d5 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:03.636712 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8b8151ca-1d0a-4062-923b-38f551fb3903 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:03.646932 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8b8151ca-1d0a-4062-923b-38f551fb3903 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1361 microversion: 2.1 time: 0.399987 Jun 08 02:06:03.659624 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 48/102] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:03 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1361 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:03.728229 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1cf67ec3-5aab-4821-98cc-4b0afe9b34d5 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:03.737582 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-1cf67ec3-5aab-4821-98cc-4b0afe9b34d5 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1322 microversion: 2.1 time: 0.246486 Jun 08 02:06:03.738838 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 55/103] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:03 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:06:03.846600 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-65123471-3af1-4ad9-8db9-fe3e2f7936d6 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:03.847401 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-65123471-3af1-4ad9-8db9-fe3e2f7936d6 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:03.863130 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-65123471-3af1-4ad9-8db9-fe3e2f7936d6 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:03.865017 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-65123471-3af1-4ad9-8db9-fe3e2f7936d6 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:03.865953 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-65123471-3af1-4ad9-8db9-fe3e2f7936d6 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:03.866491 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-65123471-3af1-4ad9-8db9-fe3e2f7936d6 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:04.057646 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=6 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:06:04.243355 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-65123471-3af1-4ad9-8db9-fe3e2f7936d6 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee50293b204bedb1ea03d77b940514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b90d01b80e450b9357d02c245c9531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:04.246751 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=100 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:06:04.258738 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-65123471-3af1-4ad9-8db9-fe3e2f7936d6 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475" status: 200 len: 1501 microversion: 2.1 time: 0.415716 Jun 08 02:06:04.264742 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 49/104] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:03 2022] GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 => generated 1501 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:04.665154 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-23954ef5-64e7-49ae-993d-538acd028f5f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:04.666867 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-23954ef5-64e7-49ae-993d-538acd028f5f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:04.677958 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-23954ef5-64e7-49ae-993d-538acd028f5f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:04.681556 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-23954ef5-64e7-49ae-993d-538acd028f5f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:04.683326 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-23954ef5-64e7-49ae-993d-538acd028f5f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:04.685127 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-23954ef5-64e7-49ae-993d-538acd028f5f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:04.755580 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-75c750df-cb2b-42bd-a23d-7709117132fc tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:04.756554 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-75c750df-cb2b-42bd-a23d-7709117132fc tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:04.763952 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-75c750df-cb2b-42bd-a23d-7709117132fc tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:04.764413 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-75c750df-cb2b-42bd-a23d-7709117132fc tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:04.765856 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-75c750df-cb2b-42bd-a23d-7709117132fc tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:04.766929 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-75c750df-cb2b-42bd-a23d-7709117132fc tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:05.094343 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-23954ef5-64e7-49ae-993d-538acd028f5f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:05.103891 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-23954ef5-64e7-49ae-993d-538acd028f5f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1361 microversion: 2.1 time: 0.444383 Jun 08 02:06:05.118931 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 56/105] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:04 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1361 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:05.167436 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-75c750df-cb2b-42bd-a23d-7709117132fc tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:05.177901 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-75c750df-cb2b-42bd-a23d-7709117132fc tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1322 microversion: 2.1 time: 0.427182 Jun 08 02:06:05.183838 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 50/106] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:04 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1322 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:05.249150 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-9923ecc9-9074-4d47-8165-cc5a3966edca req-45df0608-5a12-44c4-9a4b-f035caff36f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b508446f-daa7-46a1-be64-fd8528cfa380", "name": "network-vif-plugged", "status": "completed", "tag": "f15849eb-1bf4-44c4-8575-7be145474d94"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:06:05.267154 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-9923ecc9-9074-4d47-8165-cc5a3966edca req-45df0608-5a12-44c4-9a4b-f035caff36f1 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:05.267611 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-9923ecc9-9074-4d47-8165-cc5a3966edca req-45df0608-5a12-44c4-9a4b-f035caff36f1 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:05.295691 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-9923ecc9-9074-4d47-8165-cc5a3966edca req-45df0608-5a12-44c4-9a4b-f035caff36f1 service nova] Creating event network-vif-plugged:f15849eb-1bf4-44c4-8575-7be145474d94 for instance b508446f-daa7-46a1-be64-fd8528cfa380 on hv-cinder-84506 Jun 08 02:06:05.320240 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-9923ecc9-9074-4d47-8165-cc5a3966edca req-45df0608-5a12-44c4-9a4b-f035caff36f1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075092 Jun 08 02:06:05.323221 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 57/107] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:06:05.852789 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b3dce13d-0d33-4ece-969d-c46800b07f11 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2fbbfea-ea7c-45e8-aaf8-28e8c8750dc4"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:06:05.853884 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b3dce13d-0d33-4ece-969d-c46800b07f11 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:05.860442 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b3dce13d-0d33-4ece-969d-c46800b07f11 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:05.860951 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b3dce13d-0d33-4ece-969d-c46800b07f11 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:05.862280 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b3dce13d-0d33-4ece-969d-c46800b07f11 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:05.862719 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b3dce13d-0d33-4ece-969d-c46800b07f11 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:06.128608 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-4efab249-b61c-4c91-ae06-15c69991deea tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:06.130664 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-4efab249-b61c-4c91-ae06-15c69991deea tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:06.140129 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4efab249-b61c-4c91-ae06-15c69991deea tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:06.140983 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4efab249-b61c-4c91-ae06-15c69991deea tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:06.142141 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4efab249-b61c-4c91-ae06-15c69991deea tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:06.143672 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4efab249-b61c-4c91-ae06-15c69991deea tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:06.392480 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-4efab249-b61c-4c91-ae06-15c69991deea tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:06.404650 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-4efab249-b61c-4c91-ae06-15c69991deea tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1361 microversion: 2.1 time: 0.281912 Jun 08 02:06:06.405228 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 58/108] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:06 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1361 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:06:06.419559 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-3ba51a9f-0cec-47f8-8223-e3b8cd0a0d63 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:06.420494 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-3ba51a9f-0cec-47f8-8223-e3b8cd0a0d63 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:06.428170 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3ba51a9f-0cec-47f8-8223-e3b8cd0a0d63 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:06.428968 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3ba51a9f-0cec-47f8-8223-e3b8cd0a0d63 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:06.429945 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3ba51a9f-0cec-47f8-8223-e3b8cd0a0d63 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:06.430486 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3ba51a9f-0cec-47f8-8223-e3b8cd0a0d63 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:06.435194 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=100 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:06:06.621202 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-3ba51a9f-0cec-47f8-8223-e3b8cd0a0d63 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:06.630795 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-3ba51a9f-0cec-47f8-8223-e3b8cd0a0d63 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1322 microversion: 2.1 time: 0.215121 Jun 08 02:06:06.631850 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 59/109] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:06 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:06.798196 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b3dce13d-0d33-4ece-969d-c46800b07f11 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "POST /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.949694 Jun 08 02:06:06.798939 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 51/110] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jun 8 02:06:05 2022] POST /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475/os-volume_attachments => generated 194 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:06:07.340932 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-ff205f0b-cff5-48dc-aeae-1e822f9245b0 req-7e58b06e-880d-4c0b-9e86-2fed3d1e6da8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb925141-6220-42fb-acfe-098906d06f8b", "name": "network-vif-plugged", "status": "completed", "tag": "854f4972-75d1-4f33-b863-4ac1e9184f71"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:06:07.366187 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-ff205f0b-cff5-48dc-aeae-1e822f9245b0 req-7e58b06e-880d-4c0b-9e86-2fed3d1e6da8 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:07.366627 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-ff205f0b-cff5-48dc-aeae-1e822f9245b0 req-7e58b06e-880d-4c0b-9e86-2fed3d1e6da8 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:07.424168 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a7ba3092-5053-4df2-af0b-4d9e585fb66a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:07.424911 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a7ba3092-5053-4df2-af0b-4d9e585fb66a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:07.435065 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a7ba3092-5053-4df2-af0b-4d9e585fb66a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:07.435482 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a7ba3092-5053-4df2-af0b-4d9e585fb66a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:07.436266 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a7ba3092-5053-4df2-af0b-4d9e585fb66a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:07.445033 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a7ba3092-5053-4df2-af0b-4d9e585fb66a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:07.611155 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-ff205f0b-cff5-48dc-aeae-1e822f9245b0 req-7e58b06e-880d-4c0b-9e86-2fed3d1e6da8 service nova] Creating event network-vif-plugged:854f4972-75d1-4f33-b863-4ac1e9184f71 for instance eb925141-6220-42fb-acfe-098906d06f8b on hv-cinder-84506 Jun 08 02:06:07.617236 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-ff205f0b-cff5-48dc-aeae-1e822f9245b0 req-7e58b06e-880d-4c0b-9e86-2fed3d1e6da8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.279760 Jun 08 02:06:07.618174 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 60/111] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:06:07.636248 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a7ba3092-5053-4df2-af0b-4d9e585fb66a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:07.648970 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a7ba3092-5053-4df2-af0b-4d9e585fb66a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1548 microversion: 2.1 time: 0.229966 Jun 08 02:06:07.649616 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 52/112] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:07 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1548 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:06:07.651558 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-6c50f06f-563f-4c2a-8e8e-d4864e39ff1b tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:07.652259 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-6c50f06f-563f-4c2a-8e8e-d4864e39ff1b tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:07.661574 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6c50f06f-563f-4c2a-8e8e-d4864e39ff1b tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:07.662526 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6c50f06f-563f-4c2a-8e8e-d4864e39ff1b tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:07.664486 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6c50f06f-563f-4c2a-8e8e-d4864e39ff1b tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:07.665402 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6c50f06f-563f-4c2a-8e8e-d4864e39ff1b tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:07.666680 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7003c7ea-9872-4f05-bee1-cb75878f8d5b tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:07.667221 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7003c7ea-9872-4f05-bee1-cb75878f8d5b tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:07.673755 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7003c7ea-9872-4f05-bee1-cb75878f8d5b tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:07.674215 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7003c7ea-9872-4f05-bee1-cb75878f8d5b tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:07.674981 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7003c7ea-9872-4f05-bee1-cb75878f8d5b tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:07.675632 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7003c7ea-9872-4f05-bee1-cb75878f8d5b tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:07.804110 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7003c7ea-9872-4f05-bee1-cb75878f8d5b tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.140539 Jun 08 02:06:07.804254 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 53/113] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jun 8 02:06:07 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380/os-interface => generated 285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 02:06:07.934292 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-6c50f06f-563f-4c2a-8e8e-d4864e39ff1b tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:07.943040 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-6c50f06f-563f-4c2a-8e8e-d4864e39ff1b tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1322 microversion: 2.1 time: 0.296783 Jun 08 02:06:07.944765 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 61/114] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:07 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1322 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:08.962639 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e4cd7c91-2c82-4c84-a7c4-7bc34be07eea tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:08.963243 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e4cd7c91-2c82-4c84-a7c4-7bc34be07eea tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:08.976523 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e4cd7c91-2c82-4c84-a7c4-7bc34be07eea tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:08.976826 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e4cd7c91-2c82-4c84-a7c4-7bc34be07eea tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:08.977594 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e4cd7c91-2c82-4c84-a7c4-7bc34be07eea tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:08.978022 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e4cd7c91-2c82-4c84-a7c4-7bc34be07eea tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:09.327918 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e4cd7c91-2c82-4c84-a7c4-7bc34be07eea tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:09.340438 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e4cd7c91-2c82-4c84-a7c4-7bc34be07eea tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1322 microversion: 2.1 time: 0.383849 Jun 08 02:06:09.365931 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 54/115] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:08 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1322 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:09.491469 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-43fb7b24-8180-4516-a14e-8edd296354cf req-18b564d5-10c5-4583-ab7e-cb2e0913b6ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b508446f-daa7-46a1-be64-fd8528cfa380", "tag": "f15849eb-1bf4-44c4-8575-7be145474d94"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:06:09.518275 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-43fb7b24-8180-4516-a14e-8edd296354cf req-18b564d5-10c5-4583-ab7e-cb2e0913b6ea service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:09.518920 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-43fb7b24-8180-4516-a14e-8edd296354cf req-18b564d5-10c5-4583-ab7e-cb2e0913b6ea service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:09.553199 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-43fb7b24-8180-4516-a14e-8edd296354cf req-18b564d5-10c5-4583-ab7e-cb2e0913b6ea service nova] Creating event network-changed:f15849eb-1bf4-44c4-8575-7be145474d94 for instance b508446f-daa7-46a1-be64-fd8528cfa380 on hv-cinder-84506 Jun 08 02:06:09.570516 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-43fb7b24-8180-4516-a14e-8edd296354cf req-18b564d5-10c5-4583-ab7e-cb2e0913b6ea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082950 Jun 08 02:06:09.574902 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 62/116] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:06:10.371504 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-26561e98-9c21-477e-9f76-9e407872bbc4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:10.372217 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-26561e98-9c21-477e-9f76-9e407872bbc4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:10.380079 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-26561e98-9c21-477e-9f76-9e407872bbc4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:10.380573 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-26561e98-9c21-477e-9f76-9e407872bbc4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:10.381510 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-26561e98-9c21-477e-9f76-9e407872bbc4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:10.382088 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-26561e98-9c21-477e-9f76-9e407872bbc4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:10.616570 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-26561e98-9c21-477e-9f76-9e407872bbc4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:10.626972 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-26561e98-9c21-477e-9f76-9e407872bbc4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1322 microversion: 2.1 time: 0.259812 Jun 08 02:06:10.627774 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 55/117] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:10 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:11.645284 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-9090509f-714f-4f6a-add4-cfb0ebb63082 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:11.645990 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-9090509f-714f-4f6a-add4-cfb0ebb63082 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:11.653528 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9090509f-714f-4f6a-add4-cfb0ebb63082 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:11.654177 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9090509f-714f-4f6a-add4-cfb0ebb63082 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:11.655226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9090509f-714f-4f6a-add4-cfb0ebb63082 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:11.655774 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9090509f-714f-4f6a-add4-cfb0ebb63082 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:11.823379 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-9090509f-714f-4f6a-add4-cfb0ebb63082 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:11.833078 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-9090509f-714f-4f6a-add4-cfb0ebb63082 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1322 microversion: 2.1 time: 0.190587 Jun 08 02:06:11.834314 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 63/118] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:11 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:12.849915 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-46ed719d-9c9a-4f43-8d27-6dbe262bbe93 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:12.850702 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-46ed719d-9c9a-4f43-8d27-6dbe262bbe93 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:12.858066 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-46ed719d-9c9a-4f43-8d27-6dbe262bbe93 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:12.858513 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-46ed719d-9c9a-4f43-8d27-6dbe262bbe93 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:12.859266 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-46ed719d-9c9a-4f43-8d27-6dbe262bbe93 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:12.859715 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-46ed719d-9c9a-4f43-8d27-6dbe262bbe93 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:12.993829 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-46ed719d-9c9a-4f43-8d27-6dbe262bbe93 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:13.001163 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-46ed719d-9c9a-4f43-8d27-6dbe262bbe93 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1322 microversion: 2.1 time: 0.155624 Jun 08 02:06:13.001714 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 56/119] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:12 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:14.018667 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d98ec651-f3ba-4965-b35e-94dbc4d18bff tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:14.019280 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d98ec651-f3ba-4965-b35e-94dbc4d18bff tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:14.025966 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d98ec651-f3ba-4965-b35e-94dbc4d18bff tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:14.026411 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d98ec651-f3ba-4965-b35e-94dbc4d18bff tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:14.027170 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d98ec651-f3ba-4965-b35e-94dbc4d18bff tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:14.027604 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d98ec651-f3ba-4965-b35e-94dbc4d18bff tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:14.159927 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d98ec651-f3ba-4965-b35e-94dbc4d18bff tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:14.167957 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d98ec651-f3ba-4965-b35e-94dbc4d18bff tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1322 microversion: 2.1 time: 0.153178 Jun 08 02:06:14.168531 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 64/120] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:14 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:15.184358 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ae9bb917-d629-49ce-b749-bcac9ab656e0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:15.184994 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ae9bb917-d629-49ce-b749-bcac9ab656e0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:15.191643 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ae9bb917-d629-49ce-b749-bcac9ab656e0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:15.192097 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ae9bb917-d629-49ce-b749-bcac9ab656e0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:15.192887 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ae9bb917-d629-49ce-b749-bcac9ab656e0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:15.193322 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ae9bb917-d629-49ce-b749-bcac9ab656e0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:15.333768 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ae9bb917-d629-49ce-b749-bcac9ab656e0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:15.341141 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ae9bb917-d629-49ce-b749-bcac9ab656e0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1322 microversion: 2.1 time: 0.160526 Jun 08 02:06:15.341704 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 57/121] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:15 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:16.358297 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-340b07ed-d3a7-4b8d-8c75-2bb991a181e1 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:16.358925 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-340b07ed-d3a7-4b8d-8c75-2bb991a181e1 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:16.365717 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-340b07ed-d3a7-4b8d-8c75-2bb991a181e1 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:16.366158 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-340b07ed-d3a7-4b8d-8c75-2bb991a181e1 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:16.366903 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-340b07ed-d3a7-4b8d-8c75-2bb991a181e1 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:16.367329 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-340b07ed-d3a7-4b8d-8c75-2bb991a181e1 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:16.497294 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-340b07ed-d3a7-4b8d-8c75-2bb991a181e1 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:16.506991 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-340b07ed-d3a7-4b8d-8c75-2bb991a181e1 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1322 microversion: 2.1 time: 0.152418 Jun 08 02:06:16.507570 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 65/122] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:16 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:17.529583 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e896a9e4-d762-4914-982d-9afb750262de tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:17.530214 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e896a9e4-d762-4914-982d-9afb750262de tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:17.538976 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e896a9e4-d762-4914-982d-9afb750262de tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:17.539423 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e896a9e4-d762-4914-982d-9afb750262de tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:17.540179 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e896a9e4-d762-4914-982d-9afb750262de tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:17.540643 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e896a9e4-d762-4914-982d-9afb750262de tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:17.671818 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e896a9e4-d762-4914-982d-9afb750262de tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:17.679256 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e896a9e4-d762-4914-982d-9afb750262de tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1322 microversion: 2.1 time: 0.153621 Jun 08 02:06:17.679811 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 58/123] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:17 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:18.695687 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-8bb1369d-3eee-497d-9de7-5d5bf66974a0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:18.696288 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-8bb1369d-3eee-497d-9de7-5d5bf66974a0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:18.704020 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8bb1369d-3eee-497d-9de7-5d5bf66974a0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:18.704830 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8bb1369d-3eee-497d-9de7-5d5bf66974a0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:18.706187 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8bb1369d-3eee-497d-9de7-5d5bf66974a0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:18.706990 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8bb1369d-3eee-497d-9de7-5d5bf66974a0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:18.840132 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-8bb1369d-3eee-497d-9de7-5d5bf66974a0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:18.847409 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-8bb1369d-3eee-497d-9de7-5d5bf66974a0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1322 microversion: 2.1 time: 0.156414 Jun 08 02:06:18.847966 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 66/124] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:18 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:19.864597 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-623f401f-1af1-486d-b039-6613bec92611 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:19.865168 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-623f401f-1af1-486d-b039-6613bec92611 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:19.871657 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-623f401f-1af1-486d-b039-6613bec92611 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:19.872089 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-623f401f-1af1-486d-b039-6613bec92611 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:19.872887 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-623f401f-1af1-486d-b039-6613bec92611 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:19.873349 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-623f401f-1af1-486d-b039-6613bec92611 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:19.999612 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-623f401f-1af1-486d-b039-6613bec92611 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:20.007195 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-623f401f-1af1-486d-b039-6613bec92611 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1322 microversion: 2.1 time: 0.146860 Jun 08 02:06:20.007745 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 59/125] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:19 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:21.024019 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-058a1339-bb25-41e1-89dd-eda021443b36 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:21.024999 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-058a1339-bb25-41e1-89dd-eda021443b36 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:21.031079 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-058a1339-bb25-41e1-89dd-eda021443b36 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:21.031620 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-058a1339-bb25-41e1-89dd-eda021443b36 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:21.032376 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-058a1339-bb25-41e1-89dd-eda021443b36 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:21.032824 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-058a1339-bb25-41e1-89dd-eda021443b36 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:21.171922 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-058a1339-bb25-41e1-89dd-eda021443b36 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:21.180044 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-058a1339-bb25-41e1-89dd-eda021443b36 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1322 microversion: 2.1 time: 0.160103 Jun 08 02:06:21.180645 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 67/126] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:21 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:06:22.197057 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1887bf80-f628-49dd-a4a4-a23f034108b0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:22.197684 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-1887bf80-f628-49dd-a4a4-a23f034108b0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:22.200124 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=58 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:06:22.205534 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1887bf80-f628-49dd-a4a4-a23f034108b0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:22.205979 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1887bf80-f628-49dd-a4a4-a23f034108b0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:22.206742 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1887bf80-f628-49dd-a4a4-a23f034108b0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:22.207173 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1887bf80-f628-49dd-a4a4-a23f034108b0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:22.342125 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-1887bf80-f628-49dd-a4a4-a23f034108b0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:22.349667 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1887bf80-f628-49dd-a4a4-a23f034108b0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1516 microversion: 2.1 time: 0.157077 Jun 08 02:06:22.350222 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 60/127] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:22 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:22.368008 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f2b93a57-6f26-4f6b-b965-9dc411c203d1 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:06:22.368975 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f2b93a57-6f26-4f6b-b965-9dc411c203d1 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:22.370908 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=54 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:06:22.376037 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f2b93a57-6f26-4f6b-b965-9dc411c203d1 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:22.376602 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f2b93a57-6f26-4f6b-b965-9dc411c203d1 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:22.377362 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f2b93a57-6f26-4f6b-b965-9dc411c203d1 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:22.377795 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f2b93a57-6f26-4f6b-b965-9dc411c203d1 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:22.437832 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.objects.instance [None req-f2b93a57-6f26-4f6b-b965-9dc411c203d1 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lazy-loading 'flavor' on Instance uuid eb925141-6220-42fb-acfe-098906d06f8b {{(pid=117939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 02:06:22.556037 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f2b93a57-6f26-4f6b-b965-9dc411c203d1 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "POST /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b/action" status: 200 len: 32 microversion: 2.1 time: 0.192351 Jun 08 02:06:22.556847 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 68/128] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jun 8 02:06:22 2022] POST /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b/action => generated 32 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 08 02:06:22.565560 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e8d00567-5019-4d66-9a35-6a9554c3533e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:22.566171 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e8d00567-5019-4d66-9a35-6a9554c3533e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:22.572422 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e8d00567-5019-4d66-9a35-6a9554c3533e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:22.572884 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e8d00567-5019-4d66-9a35-6a9554c3533e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:22.573668 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e8d00567-5019-4d66-9a35-6a9554c3533e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:22.574099 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e8d00567-5019-4d66-9a35-6a9554c3533e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:22.703645 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e8d00567-5019-4d66-9a35-6a9554c3533e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:22.711356 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e8d00567-5019-4d66-9a35-6a9554c3533e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1522 microversion: 2.1 time: 0.149636 Jun 08 02:06:22.711922 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 61/129] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:22 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:23.728489 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-1263bfd2-9ab1-478d-8c28-358f94a80d72 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:23.729484 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-1263bfd2-9ab1-478d-8c28-358f94a80d72 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:23.735688 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1263bfd2-9ab1-478d-8c28-358f94a80d72 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:23.736131 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1263bfd2-9ab1-478d-8c28-358f94a80d72 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:23.736912 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1263bfd2-9ab1-478d-8c28-358f94a80d72 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:23.737345 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1263bfd2-9ab1-478d-8c28-358f94a80d72 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:23.867930 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1263bfd2-9ab1-478d-8c28-358f94a80d72 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:23.875704 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-1263bfd2-9ab1-478d-8c28-358f94a80d72 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1522 microversion: 2.1 time: 0.151196 Jun 08 02:06:23.878127 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 69/130] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:23 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:24.893558 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e985880b-6d4d-4699-a4fc-066c71f9ffec tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:24.894102 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e985880b-6d4d-4699-a4fc-066c71f9ffec tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:24.901492 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e985880b-6d4d-4699-a4fc-066c71f9ffec tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:24.901943 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e985880b-6d4d-4699-a4fc-066c71f9ffec tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:24.902791 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e985880b-6d4d-4699-a4fc-066c71f9ffec tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:24.903227 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e985880b-6d4d-4699-a4fc-066c71f9ffec tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:25.156259 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e985880b-6d4d-4699-a4fc-066c71f9ffec tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:25.164144 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e985880b-6d4d-4699-a4fc-066c71f9ffec tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1522 microversion: 2.1 time: 0.274516 Jun 08 02:06:25.164743 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 62/131] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:24 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:26.090518 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d897debb-75dd-43bb-a648-6b2cee7235a1 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:26.091000 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d897debb-75dd-43bb-a648-6b2cee7235a1 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:26.096879 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d897debb-75dd-43bb-a648-6b2cee7235a1 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:26.097316 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d897debb-75dd-43bb-a648-6b2cee7235a1 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:26.098202 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d897debb-75dd-43bb-a648-6b2cee7235a1 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:26.098633 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d897debb-75dd-43bb-a648-6b2cee7235a1 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:26.122846 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d897debb-75dd-43bb-a648-6b2cee7235a1 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Going to try to terminate instance {{(pid=117939) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 02:06:26.181624 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c251270b-5568-43dc-b57c-00218aafc8d9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:26.182168 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c251270b-5568-43dc-b57c-00218aafc8d9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:26.188746 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c251270b-5568-43dc-b57c-00218aafc8d9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:26.189195 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c251270b-5568-43dc-b57c-00218aafc8d9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:26.189957 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c251270b-5568-43dc-b57c-00218aafc8d9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:26.190394 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c251270b-5568-43dc-b57c-00218aafc8d9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:26.206124 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d897debb-75dd-43bb-a648-6b2cee7235a1 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "DELETE /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475" status: 204 len: 0 microversion: 2.1 time: 0.119051 Jun 08 02:06:26.206698 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 70/132] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jun 8 02:06:26 2022] DELETE /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 08 02:06:26.215342 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-fe6e66e6-520a-490f-8d83-8db8d60160cd tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:26.216125 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-fe6e66e6-520a-490f-8d83-8db8d60160cd tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:26.222202 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fe6e66e6-520a-490f-8d83-8db8d60160cd tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:26.222645 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fe6e66e6-520a-490f-8d83-8db8d60160cd tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:26.224198 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fe6e66e6-520a-490f-8d83-8db8d60160cd tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:26.224662 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fe6e66e6-520a-490f-8d83-8db8d60160cd tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:26.364550 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c251270b-5568-43dc-b57c-00218aafc8d9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:26.372037 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c251270b-5568-43dc-b57c-00218aafc8d9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1522 microversion: 2.1 time: 0.194268 Jun 08 02:06:26.372881 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 63/133] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:26 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:06:26.390548 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-fe6e66e6-520a-490f-8d83-8db8d60160cd tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee50293b204bedb1ea03d77b940514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b90d01b80e450b9357d02c245c9531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:26.398478 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-fe6e66e6-520a-490f-8d83-8db8d60160cd tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475" status: 200 len: 1553 microversion: 2.1 time: 0.187485 Jun 08 02:06:26.399038 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 71/134] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:26 2022] GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 => generated 1553 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:27.389062 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-db007253-05a5-483d-b8fa-bc90794f7853 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:27.389704 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-db007253-05a5-483d-b8fa-bc90794f7853 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:27.395978 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-db007253-05a5-483d-b8fa-bc90794f7853 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:27.396454 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-db007253-05a5-483d-b8fa-bc90794f7853 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:27.397221 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-db007253-05a5-483d-b8fa-bc90794f7853 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:27.397652 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-db007253-05a5-483d-b8fa-bc90794f7853 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:27.415924 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c91b0055-d109-4fde-8fed-ca27262a7a48 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:27.416669 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c91b0055-d109-4fde-8fed-ca27262a7a48 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:27.424754 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c91b0055-d109-4fde-8fed-ca27262a7a48 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:27.425313 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c91b0055-d109-4fde-8fed-ca27262a7a48 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:27.426736 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c91b0055-d109-4fde-8fed-ca27262a7a48 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:27.427249 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c91b0055-d109-4fde-8fed-ca27262a7a48 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:27.599539 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-db007253-05a5-483d-b8fa-bc90794f7853 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:27.602382 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c91b0055-d109-4fde-8fed-ca27262a7a48 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee50293b204bedb1ea03d77b940514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b90d01b80e450b9357d02c245c9531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:27.607060 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-db007253-05a5-483d-b8fa-bc90794f7853 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1522 microversion: 2.1 time: 0.221929 Jun 08 02:06:27.607709 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 64/135] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:27 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:27.610416 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c91b0055-d109-4fde-8fed-ca27262a7a48 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475" status: 200 len: 1553 microversion: 2.1 time: 0.198337 Jun 08 02:06:27.610977 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 72/136] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:27 2022] GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 => generated 1553 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:06:28.624202 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6bd2ec86-fe22-4ab0-a940-c76acb190bca tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:28.624928 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6bd2ec86-fe22-4ab0-a940-c76acb190bca tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:28.626912 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c0c12585-9ad8-4a64-b865-2d289e71122c tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:28.627652 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c0c12585-9ad8-4a64-b865-2d289e71122c tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:28.631309 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6bd2ec86-fe22-4ab0-a940-c76acb190bca tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:28.631781 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6bd2ec86-fe22-4ab0-a940-c76acb190bca tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:28.632580 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6bd2ec86-fe22-4ab0-a940-c76acb190bca tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:28.633019 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6bd2ec86-fe22-4ab0-a940-c76acb190bca tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:28.633811 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c0c12585-9ad8-4a64-b865-2d289e71122c tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:28.634255 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c0c12585-9ad8-4a64-b865-2d289e71122c tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:28.635007 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c0c12585-9ad8-4a64-b865-2d289e71122c tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:28.635466 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c0c12585-9ad8-4a64-b865-2d289e71122c tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:28.648146 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:06:28.650099 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:06:28.856879 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6bd2ec86-fe22-4ab0-a940-c76acb190bca tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:28.860715 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c0c12585-9ad8-4a64-b865-2d289e71122c tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee50293b204bedb1ea03d77b940514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b90d01b80e450b9357d02c245c9531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:28.863701 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6bd2ec86-fe22-4ab0-a940-c76acb190bca tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1522 microversion: 2.1 time: 0.243242 Jun 08 02:06:28.874522 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 65/137] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:28 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:28.878497 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c0c12585-9ad8-4a64-b865-2d289e71122c tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475" status: 200 len: 1553 microversion: 2.1 time: 0.254961 Jun 08 02:06:28.880550 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 73/138] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:28 2022] GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 => generated 1553 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:29.882490 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5df4995f-bd83-4d06-b41a-a6b534fcb9f7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:29.883126 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5df4995f-bd83-4d06-b41a-a6b534fcb9f7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:29.889687 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5df4995f-bd83-4d06-b41a-a6b534fcb9f7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:29.890137 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5df4995f-bd83-4d06-b41a-a6b534fcb9f7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:29.890915 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5df4995f-bd83-4d06-b41a-a6b534fcb9f7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:29.891336 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5df4995f-bd83-4d06-b41a-a6b534fcb9f7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:29.899418 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-8fe1c9de-339d-43d3-a2a2-000ba09d8b19 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:29.900027 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-8fe1c9de-339d-43d3-a2a2-000ba09d8b19 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:29.907461 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8fe1c9de-339d-43d3-a2a2-000ba09d8b19 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:29.907907 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8fe1c9de-339d-43d3-a2a2-000ba09d8b19 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:29.909108 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8fe1c9de-339d-43d3-a2a2-000ba09d8b19 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:29.909108 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8fe1c9de-339d-43d3-a2a2-000ba09d8b19 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:30.139139 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5df4995f-bd83-4d06-b41a-a6b534fcb9f7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:30.142922 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-8fe1c9de-339d-43d3-a2a2-000ba09d8b19 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee50293b204bedb1ea03d77b940514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b90d01b80e450b9357d02c245c9531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:30.153580 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-8fe1c9de-339d-43d3-a2a2-000ba09d8b19 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475" status: 200 len: 1553 microversion: 2.1 time: 0.258188 Jun 08 02:06:30.154368 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5df4995f-bd83-4d06-b41a-a6b534fcb9f7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1522 microversion: 2.1 time: 0.276001 Jun 08 02:06:30.154496 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 74/139] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:29 2022] GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 => generated 1553 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:06:30.155277 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 66/140] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:29 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:31.171830 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b5459052-d493-4afa-b9ac-a9153b3cce64 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:31.172475 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d1eaa6c3-eeef-4a25-9ebc-fe9307f586ad tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:31.172829 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b5459052-d493-4afa-b9ac-a9153b3cce64 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:31.172946 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d1eaa6c3-eeef-4a25-9ebc-fe9307f586ad tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:31.178564 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d1eaa6c3-eeef-4a25-9ebc-fe9307f586ad tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:31.178859 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b5459052-d493-4afa-b9ac-a9153b3cce64 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:31.178965 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d1eaa6c3-eeef-4a25-9ebc-fe9307f586ad tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:31.179302 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b5459052-d493-4afa-b9ac-a9153b3cce64 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:31.179684 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d1eaa6c3-eeef-4a25-9ebc-fe9307f586ad tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:31.180058 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b5459052-d493-4afa-b9ac-a9153b3cce64 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:31.180200 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d1eaa6c3-eeef-4a25-9ebc-fe9307f586ad tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:31.180509 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b5459052-d493-4afa-b9ac-a9153b3cce64 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:31.378733 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b5459052-d493-4afa-b9ac-a9153b3cce64 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:31.382193 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d1eaa6c3-eeef-4a25-9ebc-fe9307f586ad tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee50293b204bedb1ea03d77b940514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b90d01b80e450b9357d02c245c9531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:31.388532 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b5459052-d493-4afa-b9ac-a9153b3cce64 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1522 microversion: 2.1 time: 0.220382 Jun 08 02:06:31.389112 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 67/141] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:31 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:06:31.390361 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d1eaa6c3-eeef-4a25-9ebc-fe9307f586ad tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475" status: 200 len: 1553 microversion: 2.1 time: 0.222221 Jun 08 02:06:31.400211 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 75/142] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:31 2022] GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 => generated 1553 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:32.405717 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4aa70267-a4e3-4ec7-8a00-514750315bb2 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:32.406328 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4aa70267-a4e3-4ec7-8a00-514750315bb2 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:32.407257 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-eedeff92-22d1-44e1-9864-8238335d44e1 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:32.407857 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-eedeff92-22d1-44e1-9864-8238335d44e1 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:32.414914 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4aa70267-a4e3-4ec7-8a00-514750315bb2 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:32.415063 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eedeff92-22d1-44e1-9864-8238335d44e1 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:32.415364 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eedeff92-22d1-44e1-9864-8238335d44e1 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:32.415457 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4aa70267-a4e3-4ec7-8a00-514750315bb2 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:32.416123 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eedeff92-22d1-44e1-9864-8238335d44e1 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:32.416265 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4aa70267-a4e3-4ec7-8a00-514750315bb2 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:32.416584 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eedeff92-22d1-44e1-9864-8238335d44e1 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:32.416817 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4aa70267-a4e3-4ec7-8a00-514750315bb2 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:32.618421 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-eedeff92-22d1-44e1-9864-8238335d44e1 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee50293b204bedb1ea03d77b940514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b90d01b80e450b9357d02c245c9531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:32.623094 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4aa70267-a4e3-4ec7-8a00-514750315bb2 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:32.626968 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-eedeff92-22d1-44e1-9864-8238335d44e1 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475" status: 200 len: 1553 microversion: 2.1 time: 0.223379 Jun 08 02:06:32.627894 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 76/143] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:32 2022] GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 => generated 1553 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:06:32.631841 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4aa70267-a4e3-4ec7-8a00-514750315bb2 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1522 microversion: 2.1 time: 0.229723 Jun 08 02:06:32.641426 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 68/144] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:32 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:33.645785 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-90e9cb0c-dad9-49e3-974b-ca224710567d tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:33.647176 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-90e9cb0c-dad9-49e3-974b-ca224710567d tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:33.651607 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-705a20c7-de5f-4c33-a0e6-6d6658c912f9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:33.652336 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-705a20c7-de5f-4c33-a0e6-6d6658c912f9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:33.659299 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-90e9cb0c-dad9-49e3-974b-ca224710567d tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:33.659749 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-90e9cb0c-dad9-49e3-974b-ca224710567d tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:33.660859 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-90e9cb0c-dad9-49e3-974b-ca224710567d tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:33.661293 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-90e9cb0c-dad9-49e3-974b-ca224710567d tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:33.665757 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-705a20c7-de5f-4c33-a0e6-6d6658c912f9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:33.666207 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-705a20c7-de5f-4c33-a0e6-6d6658c912f9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:33.667000 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-705a20c7-de5f-4c33-a0e6-6d6658c912f9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:33.667607 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-705a20c7-de5f-4c33-a0e6-6d6658c912f9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:34.022721 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-90e9cb0c-dad9-49e3-974b-ca224710567d tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee50293b204bedb1ea03d77b940514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b90d01b80e450b9357d02c245c9531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:34.025820 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-705a20c7-de5f-4c33-a0e6-6d6658c912f9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:34.033750 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-705a20c7-de5f-4c33-a0e6-6d6658c912f9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1522 microversion: 2.1 time: 0.389266 Jun 08 02:06:34.034336 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 69/145] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:33 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1522 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:34.035906 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-90e9cb0c-dad9-49e3-974b-ca224710567d tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475" status: 200 len: 1553 microversion: 2.1 time: 0.393620 Jun 08 02:06:34.044813 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 77/146] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:33 2022] GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 => generated 1553 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:34.389507 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-890273ec-390a-4635-9a1d-2e38af16d98d req-129917b2-c19a-4a76-ad2d-78005abba02f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "400093fe-afb9-4690-9da0-e7a6c7103475", "name": "network-vif-deleted", "tag": "732d068c-f7fd-41f4-8c10-2743ccfb57c5"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:06:34.397678 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-890273ec-390a-4635-9a1d-2e38af16d98d req-129917b2-c19a-4a76-ad2d-78005abba02f service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:34.398118 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-890273ec-390a-4635-9a1d-2e38af16d98d req-129917b2-c19a-4a76-ad2d-78005abba02f service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:34.408847 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-890273ec-390a-4635-9a1d-2e38af16d98d req-129917b2-c19a-4a76-ad2d-78005abba02f service nova] Creating event network-vif-deleted:732d068c-f7fd-41f4-8c10-2743ccfb57c5 for instance 400093fe-afb9-4690-9da0-e7a6c7103475 on hv-cinder-84506 Jun 08 02:06:34.414507 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-890273ec-390a-4635-9a1d-2e38af16d98d req-129917b2-c19a-4a76-ad2d-78005abba02f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028605 Jun 08 02:06:34.415074 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 70/147] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:06:35.050383 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-78c92caa-14e7-4cc6-bb41-44e91aaafc51 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:35.051142 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-78c92caa-14e7-4cc6-bb41-44e91aaafc51 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:35.054157 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f7358517-f658-4572-bc55-6479e975439e tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:35.054847 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f7358517-f658-4572-bc55-6479e975439e tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:35.058070 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-78c92caa-14e7-4cc6-bb41-44e91aaafc51 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:35.058593 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-78c92caa-14e7-4cc6-bb41-44e91aaafc51 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:35.059387 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-78c92caa-14e7-4cc6-bb41-44e91aaafc51 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:35.059817 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-78c92caa-14e7-4cc6-bb41-44e91aaafc51 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:35.060984 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f7358517-f658-4572-bc55-6479e975439e tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:35.061424 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f7358517-f658-4572-bc55-6479e975439e tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:35.062171 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f7358517-f658-4572-bc55-6479e975439e tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:35.062593 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f7358517-f658-4572-bc55-6479e975439e tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:35.143454 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f7358517-f658-4572-bc55-6479e975439e tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee50293b204bedb1ea03d77b940514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b90d01b80e450b9357d02c245c9531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:35.151509 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f7358517-f658-4572-bc55-6479e975439e tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475" status: 200 len: 1511 microversion: 2.1 time: 0.102504 Jun 08 02:06:35.152078 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 71/148] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:35 2022] GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 => generated 1511 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:06:35.207393 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-78c92caa-14e7-4cc6-bb41-44e91aaafc51 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:35.215516 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-78c92caa-14e7-4cc6-bb41-44e91aaafc51 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1522 microversion: 2.1 time: 0.168995 Jun 08 02:06:35.216093 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 78/149] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:35 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:36.169283 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7288dd59-e19f-4612-82b9-37f7bd9dcfca tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:36.169897 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7288dd59-e19f-4612-82b9-37f7bd9dcfca tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:36.175845 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7288dd59-e19f-4612-82b9-37f7bd9dcfca tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:36.176291 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7288dd59-e19f-4612-82b9-37f7bd9dcfca tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:36.177096 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7288dd59-e19f-4612-82b9-37f7bd9dcfca tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:36.177566 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7288dd59-e19f-4612-82b9-37f7bd9dcfca tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:36.233497 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2a2f008c-f0b9-4553-968a-598482de2c76 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:36.234201 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-2a2f008c-f0b9-4553-968a-598482de2c76 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:36.240820 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2a2f008c-f0b9-4553-968a-598482de2c76 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:36.241402 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2a2f008c-f0b9-4553-968a-598482de2c76 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:36.242342 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2a2f008c-f0b9-4553-968a-598482de2c76 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:36.243008 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2a2f008c-f0b9-4553-968a-598482de2c76 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:36.243561 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7288dd59-e19f-4612-82b9-37f7bd9dcfca tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee50293b204bedb1ea03d77b940514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b90d01b80e450b9357d02c245c9531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:36.253752 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7288dd59-e19f-4612-82b9-37f7bd9dcfca tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475" status: 200 len: 1511 microversion: 2.1 time: 0.088771 Jun 08 02:06:36.254522 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 72/150] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:36 2022] GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 => generated 1511 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:36.384821 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2a2f008c-f0b9-4553-968a-598482de2c76 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:36.392555 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2a2f008c-f0b9-4553-968a-598482de2c76 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1522 microversion: 2.1 time: 0.163411 Jun 08 02:06:36.393121 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 79/151] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:36 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:37.272332 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-45d6510d-a23c-41b7-98bc-d7d33412ef9e tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:37.272990 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-45d6510d-a23c-41b7-98bc-d7d33412ef9e tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:37.279527 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-45d6510d-a23c-41b7-98bc-d7d33412ef9e tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:37.279967 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-45d6510d-a23c-41b7-98bc-d7d33412ef9e tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:37.280973 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-45d6510d-a23c-41b7-98bc-d7d33412ef9e tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:37.281401 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-45d6510d-a23c-41b7-98bc-d7d33412ef9e tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:37.374234 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-45d6510d-a23c-41b7-98bc-d7d33412ef9e tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee50293b204bedb1ea03d77b940514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b90d01b80e450b9357d02c245c9531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:37.403645 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-45d6510d-a23c-41b7-98bc-d7d33412ef9e tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475" status: 200 len: 1511 microversion: 2.1 time: 0.136440 Jun 08 02:06:37.409751 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-70772c5c-f3aa-4be6-ad89-6521e0d793fd tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:37.411053 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-70772c5c-f3aa-4be6-ad89-6521e0d793fd tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:37.413607 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 73/152] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:37 2022] GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 => generated 1511 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:37.429221 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-70772c5c-f3aa-4be6-ad89-6521e0d793fd tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:37.429860 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-70772c5c-f3aa-4be6-ad89-6521e0d793fd tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:37.430822 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-70772c5c-f3aa-4be6-ad89-6521e0d793fd tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:37.431302 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-70772c5c-f3aa-4be6-ad89-6521e0d793fd tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:37.580650 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-70772c5c-f3aa-4be6-ad89-6521e0d793fd tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:37.589451 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-70772c5c-f3aa-4be6-ad89-6521e0d793fd tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1522 microversion: 2.1 time: 0.183397 Jun 08 02:06:37.600050 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 80/153] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:37 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:06:38.420235 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-61760803-db7b-4ce1-b693-85babe069746 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:38.421640 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-61760803-db7b-4ce1-b693-85babe069746 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:38.436102 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-61760803-db7b-4ce1-b693-85babe069746 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:38.436591 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-61760803-db7b-4ce1-b693-85babe069746 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:38.437364 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-61760803-db7b-4ce1-b693-85babe069746 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:38.437798 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-61760803-db7b-4ce1-b693-85babe069746 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:38.452575 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-61760803-db7b-4ce1-b693-85babe069746 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] HTTP exception thrown: Instance 400093fe-afb9-4690-9da0-e7a6c7103475 could not be found. Jun 08 02:06:38.463620 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-61760803-db7b-4ce1-b693-85babe069746 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Request method failure captured: Jun 08 02:06:38.463620 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 HTTP/1.1 Jun 08 02:06:38.463620 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept: application/json Jun 08 02:06:38.463620 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jun 08 02:06:38.463620 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Connection: close Jun 08 02:06:38.463620 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jun 08 02:06:38.463620 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jun 08 02:06:38.463620 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Host: 10.222.0.20 Jun 08 02:06:38.463620 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jun 08 02:06:38.463620 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jun 08 02:06:38.463620 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABioAPhicU_rDFum0NWsSA_BfDAcxfX-vUCHmFpPX71Vf4hROUlGfVDM2dcQo79trYgar8fiYp-5wrEAJzYOs_hac00sNwrzV8u1Cf3kU81m5qVuPA3qzjjStXfDGQ4cf2IQM-NJl8enYwWrFDdYzKjX0lr8E2DRhCjLPA0AXOi4LnRJHU Jun 08 02:06:38.463620 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jun 08 02:06:38.463620 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jun 08 02:06:38.463620 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jun 08 02:06:38.463620 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jun 08 02:06:38.463620 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jun 08 02:06:38.463620 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jun 08 02:06:38.463620 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Id: 16b90d01b80e450b9357d02c245c9531 Jun 08 02:06:38.463620 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-DeleteServersTestJSON-2097106789 Jun 08 02:06:38.463620 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jun 08 02:06:38.463620 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jun 08 02:06:38.464876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/16b90d01b80e450b9357d02c245c9531"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_16b90d01b80e450b9357d02c245c9531", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/16b90d01b80e450b9357d02c245c9531"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/16b90d01b80e450b9357d02c245c9531"}]}] Jun 08 02:06:38.464876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-DeleteServersTestJSON-2097106789 Jun 08 02:06:38.464876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 16b90d01b80e450b9357d02c245c9531 Jun 08 02:06:38.464876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-DeleteServersTestJSON-2097106789 Jun 08 02:06:38.464876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User: tempest-DeleteServersTestJSON-2097106789-project Jun 08 02:06:38.464876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jun 08 02:06:38.464876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jun 08 02:06:38.464876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Id: 71ee50293b204bedb1ea03d77b940514 Jun 08 02:06:38.464876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-DeleteServersTestJSON-2097106789-project Jun 08 02:06:38.464876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: method: > Jun 08 02:06:38.464876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: exception: Instance 400093fe-afb9-4690-9da0-e7a6c7103475 could not be found. Jun 08 02:06:38.464876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: action_args: {'id': '400093fe-afb9-4690-9da0-e7a6c7103475'} Jun 08 02:06:38.465584 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:06:38.465584 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:06:38.465584 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:06:38.465584 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:06:38.465584 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:06:38.465584 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:06:38.465584 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:06:38.465584 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:06:38.465584 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:06:38.465584 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:06:38.465584 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 400093fe-afb9-4690-9da0-e7a6c7103475 could not be found. Jun 08 02:06:38.465584 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:06:38.465584 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:06:38.465584 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:06:38.465584 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:06:38.465584 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:06:38.465584 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:06:38.465584 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:06:38.465584 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:06:38.465584 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:06:38.467062 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:06:38.467062 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 02:06:38.467062 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 02:06:38.467062 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:06:38.467062 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:06:38.467062 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:06:38.467062 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:06:38.467062 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 400093fe-afb9-4690-9da0-e7a6c7103475 could not be found. Jun 08 02:06:38.467062 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:06:38.467062 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:06:38.467062 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:06:38.467062 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:06:38.467062 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:06:38.467062 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:06:38.467062 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:06:38.467062 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:06:38.467062 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 400093fe-afb9-4690-9da0-e7a6c7103475 could not be found. Jun 08 02:06:38.467062 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:06:38.468000 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-61760803-db7b-4ce1-b693-85babe069746 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Returning 404 to user: Instance 400093fe-afb9-4690-9da0-e7a6c7103475 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:06:38.468000 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-61760803-db7b-4ce1-b693-85babe069746 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475" status: 404 len: 111 microversion: 2.1 time: 0.048914 Jun 08 02:06:38.468000 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 74/154] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:38 2022] GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 02:06:38.573825 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a02c9568-5cd1-4772-b5c1-22835317a3df tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:38.574809 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a02c9568-5cd1-4772-b5c1-22835317a3df tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:38.580931 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a02c9568-5cd1-4772-b5c1-22835317a3df tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:38.581729 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a02c9568-5cd1-4772-b5c1-22835317a3df tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:38.582560 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a02c9568-5cd1-4772-b5c1-22835317a3df tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:38.582988 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a02c9568-5cd1-4772-b5c1-22835317a3df tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:38.597179 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-a02c9568-5cd1-4772-b5c1-22835317a3df tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] HTTP exception thrown: Instance 400093fe-afb9-4690-9da0-e7a6c7103475 could not be found. Jun 08 02:06:38.602208 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a02c9568-5cd1-4772-b5c1-22835317a3df tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Request method failure captured: Jun 08 02:06:38.602208 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475/os-volume_attachments HTTP/1.1 Jun 08 02:06:38.602208 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept: application/json Jun 08 02:06:38.602208 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jun 08 02:06:38.602208 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Connection: close Jun 08 02:06:38.602208 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jun 08 02:06:38.602208 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jun 08 02:06:38.602208 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Host: 10.222.0.20 Jun 08 02:06:38.602208 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jun 08 02:06:38.602208 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jun 08 02:06:38.602208 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABioAPhicU_rDFum0NWsSA_BfDAcxfX-vUCHmFpPX71Vf4hROUlGfVDM2dcQo79trYgar8fiYp-5wrEAJzYOs_hac00sNwrzV8u1Cf3kU81m5qVuPA3qzjjStXfDGQ4cf2IQM-NJl8enYwWrFDdYzKjX0lr8E2DRhCjLPA0AXOi4LnRJHU Jun 08 02:06:38.602208 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jun 08 02:06:38.602208 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jun 08 02:06:38.602208 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jun 08 02:06:38.602208 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jun 08 02:06:38.602208 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jun 08 02:06:38.602208 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jun 08 02:06:38.602208 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Id: 16b90d01b80e450b9357d02c245c9531 Jun 08 02:06:38.602208 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-DeleteServersTestJSON-2097106789 Jun 08 02:06:38.602208 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jun 08 02:06:38.602208 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jun 08 02:06:38.603623 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/16b90d01b80e450b9357d02c245c9531"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_16b90d01b80e450b9357d02c245c9531", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/16b90d01b80e450b9357d02c245c9531"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/16b90d01b80e450b9357d02c245c9531"}]}] Jun 08 02:06:38.603623 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-DeleteServersTestJSON-2097106789 Jun 08 02:06:38.603623 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 16b90d01b80e450b9357d02c245c9531 Jun 08 02:06:38.603623 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-DeleteServersTestJSON-2097106789 Jun 08 02:06:38.603623 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User: tempest-DeleteServersTestJSON-2097106789-project Jun 08 02:06:38.603623 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jun 08 02:06:38.603623 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jun 08 02:06:38.603623 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Id: 71ee50293b204bedb1ea03d77b940514 Jun 08 02:06:38.603623 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-DeleteServersTestJSON-2097106789-project Jun 08 02:06:38.603623 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: method: > Jun 08 02:06:38.603623 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: exception: Instance 400093fe-afb9-4690-9da0-e7a6c7103475 could not be found. Jun 08 02:06:38.603623 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: action_args: {'server_id': '400093fe-afb9-4690-9da0-e7a6c7103475'} Jun 08 02:06:38.604427 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:06:38.604427 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:06:38.604427 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:06:38.604427 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:06:38.604427 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:06:38.604427 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:06:38.604427 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:06:38.604427 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:06:38.604427 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:06:38.604427 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:06:38.604427 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 400093fe-afb9-4690-9da0-e7a6c7103475 could not be found. Jun 08 02:06:38.604427 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:06:38.604427 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:06:38.604427 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:06:38.604427 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:06:38.604427 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:06:38.604427 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:06:38.604427 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:06:38.604427 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:06:38.604427 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:06:38.605713 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:06:38.605713 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 08 02:06:38.605713 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 08 02:06:38.605713 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 08 02:06:38.605713 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 08 02:06:38.605713 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 08 02:06:38.605713 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 08 02:06:38.605713 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:06:38.605713 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:06:38.605713 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 400093fe-afb9-4690-9da0-e7a6c7103475 could not be found. Jun 08 02:06:38.605713 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:06:38.605713 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:06:38.605713 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:06:38.605713 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:06:38.605713 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:06:38.605713 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:06:38.605713 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:06:38.605713 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:06:38.605713 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 400093fe-afb9-4690-9da0-e7a6c7103475 could not be found. Jun 08 02:06:38.605713 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:06:38.606989 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a02c9568-5cd1-4772-b5c1-22835317a3df tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Returning 404 to user: Instance 400093fe-afb9-4690-9da0-e7a6c7103475 could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:06:38.606989 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a02c9568-5cd1-4772-b5c1-22835317a3df tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035706 Jun 08 02:06:38.607142 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6052f0a3-dbb8-4432-93ec-42a82e965245 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:38.607142 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6052f0a3-dbb8-4432-93ec-42a82e965245 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:38.607554 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 81/155] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jun 8 02:06:38 2022] GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 02:06:38.613144 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6052f0a3-dbb8-4432-93ec-42a82e965245 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:38.613589 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6052f0a3-dbb8-4432-93ec-42a82e965245 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:38.614445 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6052f0a3-dbb8-4432-93ec-42a82e965245 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:38.614782 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6052f0a3-dbb8-4432-93ec-42a82e965245 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:38.796545 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6052f0a3-dbb8-4432-93ec-42a82e965245 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:38.806479 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6052f0a3-dbb8-4432-93ec-42a82e965245 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1522 microversion: 2.1 time: 0.204065 Jun 08 02:06:38.807637 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 75/156] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:38 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:06:39.823915 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-948342af-6284-4610-92cd-cffc87a77762 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:39.825993 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-948342af-6284-4610-92cd-cffc87a77762 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:39.832112 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-948342af-6284-4610-92cd-cffc87a77762 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:39.832617 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-948342af-6284-4610-92cd-cffc87a77762 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:39.834389 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-948342af-6284-4610-92cd-cffc87a77762 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:39.835932 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-948342af-6284-4610-92cd-cffc87a77762 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:39.982438 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-948342af-6284-4610-92cd-cffc87a77762 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:39.990514 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-948342af-6284-4610-92cd-cffc87a77762 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1522 microversion: 2.1 time: 0.170613 Jun 08 02:06:39.991074 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 82/157] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:39 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:41.006732 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2a7d1e32-66c2-4af6-83bc-6337a418b82a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:41.007345 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2a7d1e32-66c2-4af6-83bc-6337a418b82a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:41.013737 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2a7d1e32-66c2-4af6-83bc-6337a418b82a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:41.014183 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2a7d1e32-66c2-4af6-83bc-6337a418b82a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:41.014935 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2a7d1e32-66c2-4af6-83bc-6337a418b82a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:41.015366 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2a7d1e32-66c2-4af6-83bc-6337a418b82a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:41.153980 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2a7d1e32-66c2-4af6-83bc-6337a418b82a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:41.161774 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2a7d1e32-66c2-4af6-83bc-6337a418b82a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1522 microversion: 2.1 time: 0.158794 Jun 08 02:06:41.162337 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 76/158] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:41 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:42.179947 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-79ca33f8-2365-4eef-ad00-40a94053f54c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:42.180677 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-79ca33f8-2365-4eef-ad00-40a94053f54c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:42.188714 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-79ca33f8-2365-4eef-ad00-40a94053f54c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:42.189417 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-79ca33f8-2365-4eef-ad00-40a94053f54c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:42.190217 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-79ca33f8-2365-4eef-ad00-40a94053f54c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:42.191023 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-79ca33f8-2365-4eef-ad00-40a94053f54c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:42.338010 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-79ca33f8-2365-4eef-ad00-40a94053f54c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:42.347318 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-79ca33f8-2365-4eef-ad00-40a94053f54c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1522 microversion: 2.1 time: 0.172933 Jun 08 02:06:42.347894 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 83/159] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:42 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:43.017210 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9e6cf5d2-e89f-49b4-b928-08862cf9e389 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:43.017702 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9e6cf5d2-e89f-49b4-b928-08862cf9e389 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:43.024299 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9e6cf5d2-e89f-49b4-b928-08862cf9e389 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:43.024932 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9e6cf5d2-e89f-49b4-b928-08862cf9e389 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:43.025723 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9e6cf5d2-e89f-49b4-b928-08862cf9e389 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:43.026581 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9e6cf5d2-e89f-49b4-b928-08862cf9e389 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:43.043814 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-9e6cf5d2-e89f-49b4-b928-08862cf9e389 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] HTTP exception thrown: Instance 400093fe-afb9-4690-9da0-e7a6c7103475 could not be found. Jun 08 02:06:43.045472 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9e6cf5d2-e89f-49b4-b928-08862cf9e389 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Request method failure captured: Jun 08 02:06:43.045472 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: request: DELETE /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 HTTP/1.1 Jun 08 02:06:43.045472 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept: application/json Jun 08 02:06:43.045472 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jun 08 02:06:43.045472 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Connection: close Jun 08 02:06:43.045472 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jun 08 02:06:43.045472 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jun 08 02:06:43.045472 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Host: 10.222.0.20 Jun 08 02:06:43.045472 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jun 08 02:06:43.045472 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jun 08 02:06:43.045472 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABioAPhicU_rDFum0NWsSA_BfDAcxfX-vUCHmFpPX71Vf4hROUlGfVDM2dcQo79trYgar8fiYp-5wrEAJzYOs_hac00sNwrzV8u1Cf3kU81m5qVuPA3qzjjStXfDGQ4cf2IQM-NJl8enYwWrFDdYzKjX0lr8E2DRhCjLPA0AXOi4LnRJHU Jun 08 02:06:43.045472 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jun 08 02:06:43.045472 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jun 08 02:06:43.045472 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jun 08 02:06:43.045472 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jun 08 02:06:43.045472 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jun 08 02:06:43.045472 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jun 08 02:06:43.045472 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Id: 16b90d01b80e450b9357d02c245c9531 Jun 08 02:06:43.045472 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-DeleteServersTestJSON-2097106789 Jun 08 02:06:43.045472 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jun 08 02:06:43.045472 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jun 08 02:06:43.046816 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/16b90d01b80e450b9357d02c245c9531"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_16b90d01b80e450b9357d02c245c9531", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/16b90d01b80e450b9357d02c245c9531"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/16b90d01b80e450b9357d02c245c9531"}]}] Jun 08 02:06:43.046816 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-DeleteServersTestJSON-2097106789 Jun 08 02:06:43.046816 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 16b90d01b80e450b9357d02c245c9531 Jun 08 02:06:43.046816 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-DeleteServersTestJSON-2097106789 Jun 08 02:06:43.046816 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User: tempest-DeleteServersTestJSON-2097106789-project Jun 08 02:06:43.046816 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jun 08 02:06:43.046816 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jun 08 02:06:43.046816 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Id: 71ee50293b204bedb1ea03d77b940514 Jun 08 02:06:43.046816 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-DeleteServersTestJSON-2097106789-project Jun 08 02:06:43.046816 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: method: > Jun 08 02:06:43.046816 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: exception: Instance 400093fe-afb9-4690-9da0-e7a6c7103475 could not be found. Jun 08 02:06:43.046816 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: action_args: {'id': '400093fe-afb9-4690-9da0-e7a6c7103475'} Jun 08 02:06:43.047551 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:06:43.047551 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:06:43.047551 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:06:43.047551 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:06:43.047551 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:06:43.047551 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:06:43.047551 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:06:43.047551 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:06:43.047551 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:06:43.047551 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:06:43.047551 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 400093fe-afb9-4690-9da0-e7a6c7103475 could not be found. Jun 08 02:06:43.047551 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:06:43.047551 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:06:43.047551 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:06:43.047551 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:06:43.047551 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:06:43.047551 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:06:43.047551 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:06:43.047551 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:06:43.047551 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:06:43.053730 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:06:43.053730 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 08 02:06:43.053730 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 08 02:06:43.053730 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 08 02:06:43.053730 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 08 02:06:43.053730 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:06:43.053730 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:06:43.053730 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:06:43.053730 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:06:43.053730 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 400093fe-afb9-4690-9da0-e7a6c7103475 could not be found. Jun 08 02:06:43.053730 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:06:43.053730 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:06:43.053730 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:06:43.053730 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:06:43.053730 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:06:43.053730 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:06:43.053730 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:06:43.053730 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:06:43.053730 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 400093fe-afb9-4690-9da0-e7a6c7103475 could not be found. Jun 08 02:06:43.053730 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:06:43.054884 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9e6cf5d2-e89f-49b4-b928-08862cf9e389 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Returning 404 to user: Instance 400093fe-afb9-4690-9da0-e7a6c7103475 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:06:43.054884 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9e6cf5d2-e89f-49b4-b928-08862cf9e389 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "DELETE /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475" status: 404 len: 111 microversion: 2.1 time: 0.034001 Jun 08 02:06:43.054884 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 77/160] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jun 8 02:06:43 2022] DELETE /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 02:06:43.056373 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-11a31442-183c-4e71-b68f-9b007b779903 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:43.057359 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-11a31442-183c-4e71-b68f-9b007b779903 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] [instance: 400093fe-afb9-4690-9da0-e7a6c7103475] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:43.064350 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-11a31442-183c-4e71-b68f-9b007b779903 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:43.064827 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-11a31442-183c-4e71-b68f-9b007b779903 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:43.065682 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-11a31442-183c-4e71-b68f-9b007b779903 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:43.066072 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-11a31442-183c-4e71-b68f-9b007b779903 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:43.082256 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-11a31442-183c-4e71-b68f-9b007b779903 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] HTTP exception thrown: Instance 400093fe-afb9-4690-9da0-e7a6c7103475 could not be found. Jun 08 02:06:43.086215 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-11a31442-183c-4e71-b68f-9b007b779903 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Request method failure captured: Jun 08 02:06:43.086215 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 HTTP/1.1 Jun 08 02:06:43.086215 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept: application/json Jun 08 02:06:43.086215 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jun 08 02:06:43.086215 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Connection: close Jun 08 02:06:43.086215 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jun 08 02:06:43.086215 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jun 08 02:06:43.086215 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Host: 10.222.0.20 Jun 08 02:06:43.086215 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jun 08 02:06:43.086215 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jun 08 02:06:43.086215 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABioAPhicU_rDFum0NWsSA_BfDAcxfX-vUCHmFpPX71Vf4hROUlGfVDM2dcQo79trYgar8fiYp-5wrEAJzYOs_hac00sNwrzV8u1Cf3kU81m5qVuPA3qzjjStXfDGQ4cf2IQM-NJl8enYwWrFDdYzKjX0lr8E2DRhCjLPA0AXOi4LnRJHU Jun 08 02:06:43.086215 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jun 08 02:06:43.086215 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jun 08 02:06:43.086215 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jun 08 02:06:43.086215 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jun 08 02:06:43.086215 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jun 08 02:06:43.086215 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jun 08 02:06:43.086215 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Id: 16b90d01b80e450b9357d02c245c9531 Jun 08 02:06:43.086215 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-DeleteServersTestJSON-2097106789 Jun 08 02:06:43.086215 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jun 08 02:06:43.086215 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jun 08 02:06:43.088057 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/16b90d01b80e450b9357d02c245c9531"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_16b90d01b80e450b9357d02c245c9531", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/16b90d01b80e450b9357d02c245c9531"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/16b90d01b80e450b9357d02c245c9531"}]}] Jun 08 02:06:43.088057 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-DeleteServersTestJSON-2097106789 Jun 08 02:06:43.088057 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 16b90d01b80e450b9357d02c245c9531 Jun 08 02:06:43.088057 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-DeleteServersTestJSON-2097106789 Jun 08 02:06:43.088057 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User: tempest-DeleteServersTestJSON-2097106789-project Jun 08 02:06:43.088057 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jun 08 02:06:43.088057 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jun 08 02:06:43.088057 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Id: 71ee50293b204bedb1ea03d77b940514 Jun 08 02:06:43.088057 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-DeleteServersTestJSON-2097106789-project Jun 08 02:06:43.088057 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: method: > Jun 08 02:06:43.088057 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: exception: Instance 400093fe-afb9-4690-9da0-e7a6c7103475 could not be found. Jun 08 02:06:43.088057 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: action_args: {'id': '400093fe-afb9-4690-9da0-e7a6c7103475'} Jun 08 02:06:43.089137 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:06:43.089137 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:06:43.089137 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:06:43.089137 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:06:43.089137 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:06:43.089137 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:06:43.089137 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:06:43.089137 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:06:43.089137 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:06:43.089137 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:06:43.089137 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 400093fe-afb9-4690-9da0-e7a6c7103475 could not be found. Jun 08 02:06:43.089137 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:06:43.089137 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:06:43.089137 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:06:43.089137 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:06:43.089137 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:06:43.089137 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:06:43.089137 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:06:43.089137 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:06:43.089137 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:06:43.090535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:06:43.090535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 02:06:43.090535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 02:06:43.090535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:06:43.090535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:06:43.090535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:06:43.090535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:06:43.090535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 400093fe-afb9-4690-9da0-e7a6c7103475 could not be found. Jun 08 02:06:43.090535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:06:43.090535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:06:43.090535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:06:43.090535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:06:43.090535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:06:43.090535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:06:43.090535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:06:43.090535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:06:43.090535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 400093fe-afb9-4690-9da0-e7a6c7103475 could not be found. Jun 08 02:06:43.090535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:06:43.092421 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-11a31442-183c-4e71-b68f-9b007b779903 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] Returning 404 to user: Instance 400093fe-afb9-4690-9da0-e7a6c7103475 could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:06:43.093253 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-11a31442-183c-4e71-b68f-9b007b779903 tempest-DeleteServersTestJSON-2097106789 tempest-DeleteServersTestJSON-2097106789-project] 10.222.0.20 "GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475" status: 404 len: 111 microversion: 2.1 time: 0.041389 Jun 08 02:06:43.093791 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 84/161] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:43 2022] GET /compute/v2.1/servers/400093fe-afb9-4690-9da0-e7a6c7103475 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 02:06:43.364080 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-af1b88b8-3e98-4675-97fe-6b7ea4e1357d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:43.364803 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-af1b88b8-3e98-4675-97fe-6b7ea4e1357d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:43.370745 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-af1b88b8-3e98-4675-97fe-6b7ea4e1357d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:43.371196 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-af1b88b8-3e98-4675-97fe-6b7ea4e1357d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:43.371948 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-af1b88b8-3e98-4675-97fe-6b7ea4e1357d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:43.372382 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-af1b88b8-3e98-4675-97fe-6b7ea4e1357d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:43.514355 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-af1b88b8-3e98-4675-97fe-6b7ea4e1357d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:43.522625 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-af1b88b8-3e98-4675-97fe-6b7ea4e1357d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1522 microversion: 2.1 time: 0.162370 Jun 08 02:06:43.523479 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 78/162] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:43 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:44.540197 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-153f5c2a-e2d2-4ea0-ae32-7b310a9313b6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:44.540867 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-153f5c2a-e2d2-4ea0-ae32-7b310a9313b6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:44.546897 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-153f5c2a-e2d2-4ea0-ae32-7b310a9313b6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:44.547347 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-153f5c2a-e2d2-4ea0-ae32-7b310a9313b6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:44.548105 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-153f5c2a-e2d2-4ea0-ae32-7b310a9313b6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:44.548566 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-153f5c2a-e2d2-4ea0-ae32-7b310a9313b6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:44.686427 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-153f5c2a-e2d2-4ea0-ae32-7b310a9313b6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:44.694529 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-153f5c2a-e2d2-4ea0-ae32-7b310a9313b6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1522 microversion: 2.1 time: 0.158499 Jun 08 02:06:44.695091 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 85/163] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:44 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:45.711059 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-97e63bd5-e506-4aad-836a-1e7adca0168a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:45.711655 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-97e63bd5-e506-4aad-836a-1e7adca0168a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:45.718020 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-97e63bd5-e506-4aad-836a-1e7adca0168a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:45.718469 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-97e63bd5-e506-4aad-836a-1e7adca0168a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:45.719239 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-97e63bd5-e506-4aad-836a-1e7adca0168a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:45.719669 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-97e63bd5-e506-4aad-836a-1e7adca0168a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:45.925662 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-97e63bd5-e506-4aad-836a-1e7adca0168a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:45.939849 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-97e63bd5-e506-4aad-836a-1e7adca0168a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1522 microversion: 2.1 time: 0.232377 Jun 08 02:06:45.941619 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 79/164] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:45 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:46.960602 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-9349fc6d-7f69-4a3c-963a-d279f5db4715 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:46.961245 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-9349fc6d-7f69-4a3c-963a-d279f5db4715 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:46.967917 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9349fc6d-7f69-4a3c-963a-d279f5db4715 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:46.968360 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9349fc6d-7f69-4a3c-963a-d279f5db4715 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:46.969337 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9349fc6d-7f69-4a3c-963a-d279f5db4715 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:46.969945 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9349fc6d-7f69-4a3c-963a-d279f5db4715 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:47.353412 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-9349fc6d-7f69-4a3c-963a-d279f5db4715 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:47.360928 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-9349fc6d-7f69-4a3c-963a-d279f5db4715 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1522 microversion: 2.1 time: 0.405825 Jun 08 02:06:47.361732 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 86/165] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:46 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1522 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:48.378857 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-69b9a792-652f-41bc-8faa-f3cf90446127 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:48.379365 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-69b9a792-652f-41bc-8faa-f3cf90446127 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:48.386870 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-69b9a792-652f-41bc-8faa-f3cf90446127 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:48.387069 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-69b9a792-652f-41bc-8faa-f3cf90446127 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:48.387804 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-69b9a792-652f-41bc-8faa-f3cf90446127 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:48.388245 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-69b9a792-652f-41bc-8faa-f3cf90446127 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:48.559909 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-69b9a792-652f-41bc-8faa-f3cf90446127 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:48.579289 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-69b9a792-652f-41bc-8faa-f3cf90446127 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1522 microversion: 2.1 time: 0.204233 Jun 08 02:06:48.580112 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 80/166] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:48 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:49.596482 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-3f0335f3-75d5-41d3-93e3-22a3559be7f7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:49.597101 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-3f0335f3-75d5-41d3-93e3-22a3559be7f7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:49.603756 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3f0335f3-75d5-41d3-93e3-22a3559be7f7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:49.604430 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3f0335f3-75d5-41d3-93e3-22a3559be7f7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:49.605216 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3f0335f3-75d5-41d3-93e3-22a3559be7f7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:49.605643 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3f0335f3-75d5-41d3-93e3-22a3559be7f7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:49.781771 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-3f0335f3-75d5-41d3-93e3-22a3559be7f7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:49.789854 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-3f0335f3-75d5-41d3-93e3-22a3559be7f7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1522 microversion: 2.1 time: 0.197239 Jun 08 02:06:49.790642 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 87/167] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:49 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:49.814510 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8bdf4d72-a5e7-43de-82e4-60d16d8c7a96 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Action: 'create', calling method: .version_select at 0x7f8370331670>, body: {"keypair": {"name": "tempest-keypair-2123619290", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBX51OUIka9qQ4NYaUJJhea1b+clIGeIS7snYS3DHyKqeyz6bwU1CqPfnBTowMX9psVa5cupVhzDiffL3fsU4nmDyLNRvXVvbFu8va53R1fj/CTnOzbXN9rsjNRp+wvgrA=="}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:06:49.829733 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-8bdf4d72-a5e7-43de-82e4-60d16d8c7a96 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Getting quotas for project 7daf0f9fd80c464ca4fbf7f2e19fccbd. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 02:06:49.834161 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-8bdf4d72-a5e7-43de-82e4-60d16d8c7a96 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Getting quotas for user a3b4081bebe74c839f5aa214275210b4 and project 7daf0f9fd80c464ca4fbf7f2e19fccbd. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 02:06:49.859880 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8bdf4d72-a5e7-43de-82e4-60d16d8c7a96 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.235546 Jun 08 02:06:49.861061 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 81/168] 10.222.0.20 () {62 vars in 1199 bytes} [Wed Jun 8 02:06:49 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 238 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 08 02:06:50.807540 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a3e00d88-dfc9-4d08-b5c8-427069ac2d55 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:50.809277 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a3e00d88-dfc9-4d08-b5c8-427069ac2d55 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:50.817498 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a3e00d88-dfc9-4d08-b5c8-427069ac2d55 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:50.819746 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a3e00d88-dfc9-4d08-b5c8-427069ac2d55 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:50.822412 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a3e00d88-dfc9-4d08-b5c8-427069ac2d55 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:50.824050 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a3e00d88-dfc9-4d08-b5c8-427069ac2d55 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:51.322999 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a3e00d88-dfc9-4d08-b5c8-427069ac2d55 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:51.350213 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a3e00d88-dfc9-4d08-b5c8-427069ac2d55 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1522 microversion: 2.1 time: 0.546450 Jun 08 02:06:51.355191 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 88/169] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:50 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1522 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:52.047166 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-dccf607b-5b17-4f7e-89f7-b0ae72db84a3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1290912604", "imageRef": "e648e482-e374-429d-8152-a4a63797f314", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "99df6c84-8305-4b75-a40c-3f742f20dcc7"}], "security_groups": [{"name": "tempest-securitygroup--1137141919"}], "key_name": "tempest-keypair-2123619290", "user_data": "}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:06:52.239589 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.network.neutron [None req-dccf607b-5b17-4f7e-89f7-b0ae72db84a3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] validate_networks() for [('99df6c84-8305-4b75-a40c-3f742f20dcc7', None, None, None, None, None)] {{(pid=117938) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 02:06:52.371240 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-6adc7a36-464b-4ea8-a10b-fae757475b8a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:52.371852 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-6adc7a36-464b-4ea8-a10b-fae757475b8a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:52.379680 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6adc7a36-464b-4ea8-a10b-fae757475b8a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:52.380320 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6adc7a36-464b-4ea8-a10b-fae757475b8a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:52.388039 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6adc7a36-464b-4ea8-a10b-fae757475b8a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:52.389117 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6adc7a36-464b-4ea8-a10b-fae757475b8a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:52.660731 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:06:52.832105 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-6adc7a36-464b-4ea8-a10b-fae757475b8a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:52.843726 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-6adc7a36-464b-4ea8-a10b-fae757475b8a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1522 microversion: 2.1 time: 0.476255 Jun 08 02:06:52.848075 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 89/170] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:52 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1522 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:06:53.214474 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-dccf607b-5b17-4f7e-89f7-b0ae72db84a3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Flavor limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 02:06:53.215698 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-dccf607b-5b17-4f7e-89f7-b0ae72db84a3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Image limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 02:06:53.216681 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-dccf607b-5b17-4f7e-89f7-b0ae72db84a3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Flavor pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 02:06:53.217748 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-dccf607b-5b17-4f7e-89f7-b0ae72db84a3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Image pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 02:06:53.218306 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-dccf607b-5b17-4f7e-89f7-b0ae72db84a3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 02:06:53.232682 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dccf607b-5b17-4f7e-89f7-b0ae72db84a3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:53.237573 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dccf607b-5b17-4f7e-89f7-b0ae72db84a3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:53.238724 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dccf607b-5b17-4f7e-89f7-b0ae72db84a3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:53.240965 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dccf607b-5b17-4f7e-89f7-b0ae72db84a3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:53.266561 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-dccf607b-5b17-4f7e-89f7-b0ae72db84a3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Getting quotas for project 7daf0f9fd80c464ca4fbf7f2e19fccbd. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 02:06:53.274474 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-dccf607b-5b17-4f7e-89f7-b0ae72db84a3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Getting quotas for user a3b4081bebe74c839f5aa214275210b4 and project 7daf0f9fd80c464ca4fbf7f2e19fccbd. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 02:06:53.315862 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-dccf607b-5b17-4f7e-89f7-b0ae72db84a3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Going to run 1 instances... {{(pid=117938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 02:06:53.326660 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-dccf607b-5b17-4f7e-89f7-b0ae72db84a3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e648e482-e374-429d-8152-a4a63797f314',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 02:06:53.511247 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-dccf607b-5b17-4f7e-89f7-b0ae72db84a3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.466359 Jun 08 02:06:53.525491 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 82/171] 10.222.0.20 () {62 vars in 1187 bytes} [Wed Jun 8 02:06:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 1485 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 08 02:06:53.538924 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ee99072c-856e-4472-b7a1-5e81c8cec601 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:53.540132 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ee99072c-856e-4472-b7a1-5e81c8cec601 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:53.575606 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:06:53.773320 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ee99072c-856e-4472-b7a1-5e81c8cec601 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:53.788291 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ee99072c-856e-4472-b7a1-5e81c8cec601 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:53.809044 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ee99072c-856e-4472-b7a1-5e81c8cec601 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:53.818705 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ee99072c-856e-4472-b7a1-5e81c8cec601 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1282 microversion: 2.20 time: 0.280301 Jun 08 02:06:53.831289 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 90/172] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:06:53 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1282 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:06:53.863193 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-90d199b6-5977-4301-a1d6-fb08c54ceed2 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:53.864485 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-90d199b6-5977-4301-a1d6-fb08c54ceed2 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:53.876827 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-90d199b6-5977-4301-a1d6-fb08c54ceed2 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:53.877285 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-90d199b6-5977-4301-a1d6-fb08c54ceed2 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:53.878065 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-90d199b6-5977-4301-a1d6-fb08c54ceed2 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:53.878503 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-90d199b6-5977-4301-a1d6-fb08c54ceed2 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:54.159012 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-90d199b6-5977-4301-a1d6-fb08c54ceed2 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:54.178719 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-90d199b6-5977-4301-a1d6-fb08c54ceed2 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1522 microversion: 2.1 time: 0.316977 Jun 08 02:06:54.179162 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 83/173] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:53 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:54.845517 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f4b26cd7-b065-4b2a-b063-4b01265e192a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:54.846146 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f4b26cd7-b065-4b2a-b063-4b01265e192a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:54.858178 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f4b26cd7-b065-4b2a-b063-4b01265e192a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:54.858620 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f4b26cd7-b065-4b2a-b063-4b01265e192a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:54.861710 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f4b26cd7-b065-4b2a-b063-4b01265e192a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:54.862180 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f4b26cd7-b065-4b2a-b063-4b01265e192a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:54.944760 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f4b26cd7-b065-4b2a-b063-4b01265e192a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:54.954014 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f4b26cd7-b065-4b2a-b063-4b01265e192a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:54.955536 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f4b26cd7-b065-4b2a-b063-4b01265e192a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:54.956670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f4b26cd7-b065-4b2a-b063-4b01265e192a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1286 microversion: 2.20 time: 0.121821 Jun 08 02:06:54.960813 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 91/174] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:06:54 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1286 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:06:55.199196 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0d7d2a54-97ab-4d53-8c09-e5fb5f4ffa84 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:55.199658 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0d7d2a54-97ab-4d53-8c09-e5fb5f4ffa84 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:55.207194 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0d7d2a54-97ab-4d53-8c09-e5fb5f4ffa84 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:55.207684 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0d7d2a54-97ab-4d53-8c09-e5fb5f4ffa84 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:55.208481 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0d7d2a54-97ab-4d53-8c09-e5fb5f4ffa84 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:55.209081 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0d7d2a54-97ab-4d53-8c09-e5fb5f4ffa84 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:55.455602 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0d7d2a54-97ab-4d53-8c09-e5fb5f4ffa84 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:55.470808 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0d7d2a54-97ab-4d53-8c09-e5fb5f4ffa84 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1522 microversion: 2.1 time: 0.275802 Jun 08 02:06:55.472351 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 84/175] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:55 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:55.975534 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-4d8fa1cf-e2ee-4a5a-8b10-b4c629a29828 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:55.976144 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-4d8fa1cf-e2ee-4a5a-8b10-b4c629a29828 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:55.983376 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4d8fa1cf-e2ee-4a5a-8b10-b4c629a29828 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:55.984317 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4d8fa1cf-e2ee-4a5a-8b10-b4c629a29828 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:55.985427 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4d8fa1cf-e2ee-4a5a-8b10-b4c629a29828 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:55.986024 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4d8fa1cf-e2ee-4a5a-8b10-b4c629a29828 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:56.001674 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=100 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:06:56.061776 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-4d8fa1cf-e2ee-4a5a-8b10-b4c629a29828 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:56.071897 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-4d8fa1cf-e2ee-4a5a-8b10-b4c629a29828 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:56.073456 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-4d8fa1cf-e2ee-4a5a-8b10-b4c629a29828 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:56.074681 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-4d8fa1cf-e2ee-4a5a-8b10-b4c629a29828 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1334 microversion: 2.20 time: 0.103429 Jun 08 02:06:56.075395 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 92/176] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:06:55 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1334 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 02:06:56.488968 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-01e0c0d7-83ad-4a2d-9c66-a834b4b4a311 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:56.490907 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-01e0c0d7-83ad-4a2d-9c66-a834b4b4a311 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:56.500178 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-01e0c0d7-83ad-4a2d-9c66-a834b4b4a311 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:56.501421 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-01e0c0d7-83ad-4a2d-9c66-a834b4b4a311 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:56.502479 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-01e0c0d7-83ad-4a2d-9c66-a834b4b4a311 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:56.503931 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-01e0c0d7-83ad-4a2d-9c66-a834b4b4a311 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:56.761066 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-01e0c0d7-83ad-4a2d-9c66-a834b4b4a311 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:56.764021 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=100 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:06:56.773083 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-01e0c0d7-83ad-4a2d-9c66-a834b4b4a311 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1522 microversion: 2.1 time: 0.288078 Jun 08 02:06:56.774241 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 85/177] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:56 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:57.093507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-150a93fd-703b-42a2-9e97-a07f1a8359b2 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:57.094121 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-150a93fd-703b-42a2-9e97-a07f1a8359b2 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:57.100901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-150a93fd-703b-42a2-9e97-a07f1a8359b2 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:57.101568 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-150a93fd-703b-42a2-9e97-a07f1a8359b2 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:57.102329 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-150a93fd-703b-42a2-9e97-a07f1a8359b2 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:57.102911 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-150a93fd-703b-42a2-9e97-a07f1a8359b2 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:57.176569 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-150a93fd-703b-42a2-9e97-a07f1a8359b2 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:57.188937 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-150a93fd-703b-42a2-9e97-a07f1a8359b2 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:57.188937 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-150a93fd-703b-42a2-9e97-a07f1a8359b2 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:57.189847 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-150a93fd-703b-42a2-9e97-a07f1a8359b2 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1352 microversion: 2.20 time: 0.100071 Jun 08 02:06:57.190402 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 93/178] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:06:57 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:06:57.791529 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7350b1e9-5a81-4b5a-ad44-19eaddb58bb7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:57.792921 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7350b1e9-5a81-4b5a-ad44-19eaddb58bb7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:57.809984 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7350b1e9-5a81-4b5a-ad44-19eaddb58bb7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:57.810830 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7350b1e9-5a81-4b5a-ad44-19eaddb58bb7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:57.812185 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7350b1e9-5a81-4b5a-ad44-19eaddb58bb7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:57.812816 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7350b1e9-5a81-4b5a-ad44-19eaddb58bb7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:58.000242 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7350b1e9-5a81-4b5a-ad44-19eaddb58bb7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:58.009375 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7350b1e9-5a81-4b5a-ad44-19eaddb58bb7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1522 microversion: 2.1 time: 0.222459 Jun 08 02:06:58.010439 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 86/179] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:57 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:58.210023 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-9a8426ba-cbba-4ed7-95f6-5c475c3f791c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:58.210644 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-9a8426ba-cbba-4ed7-95f6-5c475c3f791c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:58.221268 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9a8426ba-cbba-4ed7-95f6-5c475c3f791c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:58.222339 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9a8426ba-cbba-4ed7-95f6-5c475c3f791c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:58.223843 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9a8426ba-cbba-4ed7-95f6-5c475c3f791c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:58.224635 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9a8426ba-cbba-4ed7-95f6-5c475c3f791c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:58.354454 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-9a8426ba-cbba-4ed7-95f6-5c475c3f791c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:58.368003 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-9a8426ba-cbba-4ed7-95f6-5c475c3f791c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:58.369836 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-9a8426ba-cbba-4ed7-95f6-5c475c3f791c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:58.371040 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-9a8426ba-cbba-4ed7-95f6-5c475c3f791c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1352 microversion: 2.20 time: 0.166424 Jun 08 02:06:58.371609 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 94/180] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:06:58 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1352 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:06:59.028259 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8c9b60ba-7abe-4431-8108-6a896d6c121a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:59.029495 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8c9b60ba-7abe-4431-8108-6a896d6c121a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:59.038698 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8c9b60ba-7abe-4431-8108-6a896d6c121a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:59.039397 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8c9b60ba-7abe-4431-8108-6a896d6c121a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:59.040554 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8c9b60ba-7abe-4431-8108-6a896d6c121a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:59.045493 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8c9b60ba-7abe-4431-8108-6a896d6c121a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:59.225006 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8c9b60ba-7abe-4431-8108-6a896d6c121a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:59.234194 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8c9b60ba-7abe-4431-8108-6a896d6c121a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1522 microversion: 2.1 time: 0.210894 Jun 08 02:06:59.243953 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 87/181] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:06:59 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:06:59.393894 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-26f32e3d-2910-44d5-974c-6ab2fcbe633a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:06:59.395787 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-26f32e3d-2910-44d5-974c-6ab2fcbe633a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:06:59.403558 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-26f32e3d-2910-44d5-974c-6ab2fcbe633a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:59.404335 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-26f32e3d-2910-44d5-974c-6ab2fcbe633a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:59.405437 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-26f32e3d-2910-44d5-974c-6ab2fcbe633a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:06:59.406173 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-26f32e3d-2910-44d5-974c-6ab2fcbe633a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:06:59.500670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-26f32e3d-2910-44d5-974c-6ab2fcbe633a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:59.512787 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-26f32e3d-2910-44d5-974c-6ab2fcbe633a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:59.516082 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-26f32e3d-2910-44d5-974c-6ab2fcbe633a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:06:59.517474 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-26f32e3d-2910-44d5-974c-6ab2fcbe633a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1352 microversion: 2.20 time: 0.130651 Jun 08 02:06:59.528322 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 95/182] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:06:59 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1352 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:07:00.252688 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5b384fa0-b5b7-443a-8a95-b8d97773767d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:00.253827 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5b384fa0-b5b7-443a-8a95-b8d97773767d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:00.262458 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5b384fa0-b5b7-443a-8a95-b8d97773767d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:00.263334 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5b384fa0-b5b7-443a-8a95-b8d97773767d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:00.264128 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5b384fa0-b5b7-443a-8a95-b8d97773767d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:00.264746 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5b384fa0-b5b7-443a-8a95-b8d97773767d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:00.496575 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5b384fa0-b5b7-443a-8a95-b8d97773767d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:00.507307 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5b384fa0-b5b7-443a-8a95-b8d97773767d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1522 microversion: 2.1 time: 0.259359 Jun 08 02:07:00.516314 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 88/183] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:00 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:00.537016 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-737eb859-e352-48ed-87bd-5e434f032e29 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:00.537616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-737eb859-e352-48ed-87bd-5e434f032e29 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:00.544127 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-737eb859-e352-48ed-87bd-5e434f032e29 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:00.544757 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-737eb859-e352-48ed-87bd-5e434f032e29 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:00.545653 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-737eb859-e352-48ed-87bd-5e434f032e29 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:00.547862 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-737eb859-e352-48ed-87bd-5e434f032e29 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:00.780712 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-737eb859-e352-48ed-87bd-5e434f032e29 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:00.796027 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-737eb859-e352-48ed-87bd-5e434f032e29 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:00.798165 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-737eb859-e352-48ed-87bd-5e434f032e29 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:00.800484 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-737eb859-e352-48ed-87bd-5e434f032e29 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1408 microversion: 2.20 time: 0.267804 Jun 08 02:07:00.801272 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 96/184] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:07:00 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1408 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:07:00.932290 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e668332d-369b-4d54-8b7e-8637f3f1092b tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1565562182", "imageRef": "e648e482-e374-429d-8152-a4a63797f314", "flavorRef": "452", "networks": [{"uuid": "8a44e4e9-cba1-44cd-ba3b-400779da1d15"}]}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:07:01.037901 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.network.neutron [None req-e668332d-369b-4d54-8b7e-8637f3f1092b tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] validate_networks() for [('8a44e4e9-cba1-44cd-ba3b-400779da1d15', None, None, None, None, None)] {{(pid=117938) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 02:07:01.527272 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-cb6d303b-3d40-4784-91f9-95d12108c6eb tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:01.527272 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-cb6d303b-3d40-4784-91f9-95d12108c6eb tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:01.540507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cb6d303b-3d40-4784-91f9-95d12108c6eb tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:01.541312 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cb6d303b-3d40-4784-91f9-95d12108c6eb tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:01.541769 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cb6d303b-3d40-4784-91f9-95d12108c6eb tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:01.542368 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cb6d303b-3d40-4784-91f9-95d12108c6eb tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:01.679955 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-e668332d-369b-4d54-8b7e-8637f3f1092b tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Flavor limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 02:07:01.680522 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-e668332d-369b-4d54-8b7e-8637f3f1092b tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Image limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 02:07:01.680854 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-e668332d-369b-4d54-8b7e-8637f3f1092b tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Flavor pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 02:07:01.681258 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-e668332d-369b-4d54-8b7e-8637f3f1092b tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Image pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 02:07:01.681665 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-e668332d-369b-4d54-8b7e-8637f3f1092b tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 02:07:01.698473 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e668332d-369b-4d54-8b7e-8637f3f1092b tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:01.698960 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e668332d-369b-4d54-8b7e-8637f3f1092b tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:01.699771 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e668332d-369b-4d54-8b7e-8637f3f1092b tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:01.700267 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e668332d-369b-4d54-8b7e-8637f3f1092b tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:01.726527 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-e668332d-369b-4d54-8b7e-8637f3f1092b tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Getting quotas for project 540c921edbf24dbeaf13675b583bb464. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 02:07:01.735294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-e668332d-369b-4d54-8b7e-8637f3f1092b tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Getting quotas for user cc19addacb9c412cb008e243c1fc7ace and project 540c921edbf24dbeaf13675b583bb464. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 02:07:01.749231 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e668332d-369b-4d54-8b7e-8637f3f1092b tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Going to run 1 instances... {{(pid=117938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 02:07:01.751640 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e668332d-369b-4d54-8b7e-8637f3f1092b tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: 82829d3a-716e-45c0-8d9a-5f560b9b96a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e648e482-e374-429d-8152-a4a63797f314',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 02:07:01.806300 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-cb6d303b-3d40-4784-91f9-95d12108c6eb tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:01.813087 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e668332d-369b-4d54-8b7e-8637f3f1092b tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.885234 Jun 08 02:07:01.814052 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-cb6d303b-3d40-4784-91f9-95d12108c6eb tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1502 microversion: 2.1 time: 0.293877 Jun 08 02:07:01.814504 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 89/185] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jun 8 02:07:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 08 02:07:01.819228 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a8598330-9f4c-456d-8a65-5143b18f7b5c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:01.819838 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a8598330-9f4c-456d-8a65-5143b18f7b5c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:01.825175 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 97/186] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:01 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1502 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:07:01.830606 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f17ec537-6fcd-422b-9250-3d8319f8a808 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:01.831544 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f17ec537-6fcd-422b-9250-3d8319f8a808 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: 82829d3a-716e-45c0-8d9a-5f560b9b96a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:01.838872 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a8598330-9f4c-456d-8a65-5143b18f7b5c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:01.839296 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a8598330-9f4c-456d-8a65-5143b18f7b5c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:01.840093 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a8598330-9f4c-456d-8a65-5143b18f7b5c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:01.840668 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a8598330-9f4c-456d-8a65-5143b18f7b5c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:01.909352 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f17ec537-6fcd-422b-9250-3d8319f8a808 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc19addacb9c412cb008e243c1fc7ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540c921edbf24dbeaf13675b583bb464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:01.932746 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f17ec537-6fcd-422b-9250-3d8319f8a808 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6" status: 200 len: 1214 microversion: 2.1 time: 0.105996 Jun 08 02:07:01.935440 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 98/187] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:01 2022] GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6 => generated 1214 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:01.944117 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f0f81c06-eb7f-48fc-8c2c-dcfac2e4775c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:01.945453 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f0f81c06-eb7f-48fc-8c2c-dcfac2e4775c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:01.954855 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f0f81c06-eb7f-48fc-8c2c-dcfac2e4775c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:01.955971 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f0f81c06-eb7f-48fc-8c2c-dcfac2e4775c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:01.956985 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f0f81c06-eb7f-48fc-8c2c-dcfac2e4775c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:01.958316 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f0f81c06-eb7f-48fc-8c2c-dcfac2e4775c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:02.148969 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a8598330-9f4c-456d-8a65-5143b18f7b5c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:02.166136 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a8598330-9f4c-456d-8a65-5143b18f7b5c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:02.168516 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a8598330-9f4c-456d-8a65-5143b18f7b5c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:02.169907 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a8598330-9f4c-456d-8a65-5143b18f7b5c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1408 microversion: 2.20 time: 0.354127 Jun 08 02:07:02.170520 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 90/188] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:07:01 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1408 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:07:02.224061 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f0f81c06-eb7f-48fc-8c2c-dcfac2e4775c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:02.232969 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f0f81c06-eb7f-48fc-8c2c-dcfac2e4775c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1516 microversion: 2.1 time: 0.293034 Jun 08 02:07:02.234240 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 99/189] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:01 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1516 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:02.622709 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-b8cdbcec-e6be-4ec6-8641-83c473051c9a req-4280dc22-84fd-45d8-b21a-68f13ea18d4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7944f2e-2294-4a69-bd4e-d51f50e73e56", "tag": "4c178719-6047-43d9-9d57-30618b0b060e"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:07:02.639377 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-b8cdbcec-e6be-4ec6-8641-83c473051c9a req-4280dc22-84fd-45d8-b21a-68f13ea18d4a service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:02.639377 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-b8cdbcec-e6be-4ec6-8641-83c473051c9a req-4280dc22-84fd-45d8-b21a-68f13ea18d4a service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:02.662419 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-b8cdbcec-e6be-4ec6-8641-83c473051c9a req-4280dc22-84fd-45d8-b21a-68f13ea18d4a service nova] Creating event network-changed:4c178719-6047-43d9-9d57-30618b0b060e for instance b7944f2e-2294-4a69-bd4e-d51f50e73e56 on hv-cinder-84506 Jun 08 02:07:02.683043 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-b8cdbcec-e6be-4ec6-8641-83c473051c9a req-4280dc22-84fd-45d8-b21a-68f13ea18d4a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067053 Jun 08 02:07:02.684321 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 91/190] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:07:02.955095 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ccf9c742-a710-4aff-ac26-c7103dcd84d4 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:02.961350 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ccf9c742-a710-4aff-ac26-c7103dcd84d4 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: 82829d3a-716e-45c0-8d9a-5f560b9b96a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:02.973575 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ccf9c742-a710-4aff-ac26-c7103dcd84d4 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:02.979831 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ccf9c742-a710-4aff-ac26-c7103dcd84d4 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:02.984993 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ccf9c742-a710-4aff-ac26-c7103dcd84d4 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:02.986059 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ccf9c742-a710-4aff-ac26-c7103dcd84d4 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:03.100798 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ccf9c742-a710-4aff-ac26-c7103dcd84d4 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc19addacb9c412cb008e243c1fc7ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540c921edbf24dbeaf13675b583bb464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:03.109112 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ccf9c742-a710-4aff-ac26-c7103dcd84d4 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6" status: 200 len: 1266 microversion: 2.1 time: 0.158047 Jun 08 02:07:03.110029 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 100/191] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:02 2022] GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:03.188459 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1e76190b-c32c-4e61-b23b-2560f8913e3c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:03.188827 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-1e76190b-c32c-4e61-b23b-2560f8913e3c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:03.196213 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1e76190b-c32c-4e61-b23b-2560f8913e3c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:03.196756 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1e76190b-c32c-4e61-b23b-2560f8913e3c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:03.197535 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1e76190b-c32c-4e61-b23b-2560f8913e3c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:03.197971 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1e76190b-c32c-4e61-b23b-2560f8913e3c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:03.338108 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-1e76190b-c32c-4e61-b23b-2560f8913e3c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:03.347072 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-1e76190b-c32c-4e61-b23b-2560f8913e3c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:03.349087 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-1e76190b-c32c-4e61-b23b-2560f8913e3c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:03.350190 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1e76190b-c32c-4e61-b23b-2560f8913e3c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1408 microversion: 2.20 time: 0.166917 Jun 08 02:07:03.350874 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 92/192] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:07:03 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:07:04.111947 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e1358075-2b14-4c88-9933-4d9900c5b753 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:07:04.114056 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e1358075-2b14-4c88-9933-4d9900c5b753 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:04.120636 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e1358075-2b14-4c88-9933-4d9900c5b753 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:04.121088 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e1358075-2b14-4c88-9933-4d9900c5b753 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:04.128084 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8c025e3d-2c52-44f2-bab3-4e2a35572dd2 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:04.128937 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8c025e3d-2c52-44f2-bab3-4e2a35572dd2 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: 82829d3a-716e-45c0-8d9a-5f560b9b96a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:04.139396 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e1358075-2b14-4c88-9933-4d9900c5b753 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:04.139940 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e1358075-2b14-4c88-9933-4d9900c5b753 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:04.144876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8c025e3d-2c52-44f2-bab3-4e2a35572dd2 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:04.145397 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8c025e3d-2c52-44f2-bab3-4e2a35572dd2 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:04.146245 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8c025e3d-2c52-44f2-bab3-4e2a35572dd2 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:04.146767 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8c025e3d-2c52-44f2-bab3-4e2a35572dd2 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:04.168073 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.objects.instance [None req-e1358075-2b14-4c88-9933-4d9900c5b753 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lazy-loading 'flavor' on Instance uuid f4fe47a1-fdef-478e-94c7-42b5945a57ae {{(pid=117939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 02:07:04.262156 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8c025e3d-2c52-44f2-bab3-4e2a35572dd2 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc19addacb9c412cb008e243c1fc7ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540c921edbf24dbeaf13675b583bb464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:04.272762 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8c025e3d-2c52-44f2-bab3-4e2a35572dd2 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6" status: 200 len: 1284 microversion: 2.1 time: 0.149653 Jun 08 02:07:04.283273 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 93/193] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:04 2022] GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6 => generated 1284 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:04.289743 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e1358075-2b14-4c88-9933-4d9900c5b753 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "POST /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae/action" status: 200 len: 32 microversion: 2.1 time: 0.180190 Jun 08 02:07:04.291768 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 101/194] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jun 8 02:07:04 2022] POST /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae/action => generated 32 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 08 02:07:04.308170 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0f47969a-e22b-4aeb-881b-2fc8da971c80 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:04.308995 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0f47969a-e22b-4aeb-881b-2fc8da971c80 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:04.316333 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0f47969a-e22b-4aeb-881b-2fc8da971c80 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:04.317914 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0f47969a-e22b-4aeb-881b-2fc8da971c80 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:04.319803 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0f47969a-e22b-4aeb-881b-2fc8da971c80 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:04.320533 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0f47969a-e22b-4aeb-881b-2fc8da971c80 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:04.373310 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2b453c21-1975-4206-b05f-af12df6addda tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:04.374395 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-2b453c21-1975-4206-b05f-af12df6addda tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:04.385779 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2b453c21-1975-4206-b05f-af12df6addda tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:04.386226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2b453c21-1975-4206-b05f-af12df6addda tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:04.387062 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2b453c21-1975-4206-b05f-af12df6addda tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:04.388627 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2b453c21-1975-4206-b05f-af12df6addda tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:04.803266 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0f47969a-e22b-4aeb-881b-2fc8da971c80 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:04.812295 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0f47969a-e22b-4aeb-881b-2fc8da971c80 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1522 microversion: 2.1 time: 0.514805 Jun 08 02:07:04.812908 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 94/195] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:04 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1522 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:04.947735 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2b453c21-1975-4206-b05f-af12df6addda tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:04.962087 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2b453c21-1975-4206-b05f-af12df6addda tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:04.964918 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2b453c21-1975-4206-b05f-af12df6addda tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:04.966198 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2b453c21-1975-4206-b05f-af12df6addda tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1408 microversion: 2.20 time: 0.601060 Jun 08 02:07:04.966910 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 102/196] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:07:04 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1408 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 02:07:05.291731 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3702c90b-3dd0-4e62-8e2a-c40c09297b70 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:05.292769 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3702c90b-3dd0-4e62-8e2a-c40c09297b70 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: 82829d3a-716e-45c0-8d9a-5f560b9b96a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:05.303902 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3702c90b-3dd0-4e62-8e2a-c40c09297b70 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:05.304627 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3702c90b-3dd0-4e62-8e2a-c40c09297b70 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:05.305662 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3702c90b-3dd0-4e62-8e2a-c40c09297b70 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:05.306158 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3702c90b-3dd0-4e62-8e2a-c40c09297b70 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:05.392417 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3702c90b-3dd0-4e62-8e2a-c40c09297b70 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc19addacb9c412cb008e243c1fc7ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540c921edbf24dbeaf13675b583bb464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:05.403265 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3702c90b-3dd0-4e62-8e2a-c40c09297b70 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6" status: 200 len: 1272 microversion: 2.1 time: 0.114932 Jun 08 02:07:05.405782 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 95/197] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:05 2022] GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6 => generated 1272 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:05.829702 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-8de3a0db-72c2-49a3-b1d9-9a82f2843329 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:05.830307 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-8de3a0db-72c2-49a3-b1d9-9a82f2843329 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:05.836696 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8de3a0db-72c2-49a3-b1d9-9a82f2843329 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:05.837152 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8de3a0db-72c2-49a3-b1d9-9a82f2843329 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:05.837968 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8de3a0db-72c2-49a3-b1d9-9a82f2843329 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:05.838399 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8de3a0db-72c2-49a3-b1d9-9a82f2843329 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:05.982707 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-8de3a0db-72c2-49a3-b1d9-9a82f2843329 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:05.987286 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-191ae822-0c1e-4e0a-9a8e-26ef53ff1fa7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:05.987898 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-191ae822-0c1e-4e0a-9a8e-26ef53ff1fa7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:05.995633 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-191ae822-0c1e-4e0a-9a8e-26ef53ff1fa7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:05.996159 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-191ae822-0c1e-4e0a-9a8e-26ef53ff1fa7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:05.996956 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-191ae822-0c1e-4e0a-9a8e-26ef53ff1fa7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:05.997379 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-191ae822-0c1e-4e0a-9a8e-26ef53ff1fa7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:05.997567 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-8de3a0db-72c2-49a3-b1d9-9a82f2843329 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1522 microversion: 2.1 time: 0.171606 Jun 08 02:07:05.998157 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 103/198] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:05 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:07:06.201534 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-191ae822-0c1e-4e0a-9a8e-26ef53ff1fa7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:06.210752 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-191ae822-0c1e-4e0a-9a8e-26ef53ff1fa7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:06.212500 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-191ae822-0c1e-4e0a-9a8e-26ef53ff1fa7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:06.213607 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-191ae822-0c1e-4e0a-9a8e-26ef53ff1fa7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1408 microversion: 2.20 time: 0.230522 Jun 08 02:07:06.214184 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 96/199] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:07:05 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1408 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 02:07:06.421276 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-5e519bf1-3068-4422-84e0-f8102edad82d tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:06.421875 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-5e519bf1-3068-4422-84e0-f8102edad82d tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: 82829d3a-716e-45c0-8d9a-5f560b9b96a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:06.427991 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5e519bf1-3068-4422-84e0-f8102edad82d tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:06.428454 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5e519bf1-3068-4422-84e0-f8102edad82d tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:06.429204 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5e519bf1-3068-4422-84e0-f8102edad82d tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:06.429954 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5e519bf1-3068-4422-84e0-f8102edad82d tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:06.570105 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-5e519bf1-3068-4422-84e0-f8102edad82d tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc19addacb9c412cb008e243c1fc7ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540c921edbf24dbeaf13675b583bb464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:06.577828 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-5e519bf1-3068-4422-84e0-f8102edad82d tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6" status: 200 len: 1314 microversion: 2.1 time: 0.160780 Jun 08 02:07:06.578389 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 104/200] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:06 2022] GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:07.014653 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-33632cee-7c30-413e-b00a-07c20211cbd8 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:07.015283 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-33632cee-7c30-413e-b00a-07c20211cbd8 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:07.021788 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-33632cee-7c30-413e-b00a-07c20211cbd8 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:07.022228 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-33632cee-7c30-413e-b00a-07c20211cbd8 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:07.022992 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-33632cee-7c30-413e-b00a-07c20211cbd8 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:07.023429 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-33632cee-7c30-413e-b00a-07c20211cbd8 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:07.171417 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-33632cee-7c30-413e-b00a-07c20211cbd8 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:07.183019 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-33632cee-7c30-413e-b00a-07c20211cbd8 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1522 microversion: 2.1 time: 0.172063 Jun 08 02:07:07.183760 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 97/201] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:07 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:07.233484 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-7cadd8a0-ad2e-4b0a-a8c8-5780f78a72c7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:07.234159 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-7cadd8a0-ad2e-4b0a-a8c8-5780f78a72c7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:07.240510 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7cadd8a0-ad2e-4b0a-a8c8-5780f78a72c7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:07.240953 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7cadd8a0-ad2e-4b0a-a8c8-5780f78a72c7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:07.241699 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7cadd8a0-ad2e-4b0a-a8c8-5780f78a72c7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:07.242123 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7cadd8a0-ad2e-4b0a-a8c8-5780f78a72c7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:07.377284 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7cadd8a0-ad2e-4b0a-a8c8-5780f78a72c7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:07.388205 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7cadd8a0-ad2e-4b0a-a8c8-5780f78a72c7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:07.390123 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7cadd8a0-ad2e-4b0a-a8c8-5780f78a72c7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:07.399163 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-7cadd8a0-ad2e-4b0a-a8c8-5780f78a72c7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1408 microversion: 2.20 time: 0.169620 Jun 08 02:07:07.399917 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 105/202] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:07:07 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:07:07.594488 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-bbdc2688-2e6d-4465-ae32-775a457ccd91 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:07.595100 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-bbdc2688-2e6d-4465-ae32-775a457ccd91 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: 82829d3a-716e-45c0-8d9a-5f560b9b96a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:07.602002 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bbdc2688-2e6d-4465-ae32-775a457ccd91 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:07.602294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bbdc2688-2e6d-4465-ae32-775a457ccd91 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:07.603042 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bbdc2688-2e6d-4465-ae32-775a457ccd91 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:07.603466 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bbdc2688-2e6d-4465-ae32-775a457ccd91 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:07.735416 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-bbdc2688-2e6d-4465-ae32-775a457ccd91 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc19addacb9c412cb008e243c1fc7ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540c921edbf24dbeaf13675b583bb464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:07.747492 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-bbdc2688-2e6d-4465-ae32-775a457ccd91 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6" status: 200 len: 1314 microversion: 2.1 time: 0.157568 Jun 08 02:07:07.748103 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 98/203] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:07 2022] GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:08.199519 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-88f5ebd1-76c1-4d84-bbfd-bdd2e904190e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:08.200553 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-88f5ebd1-76c1-4d84-bbfd-bdd2e904190e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:08.208868 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-88f5ebd1-76c1-4d84-bbfd-bdd2e904190e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:08.209534 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-88f5ebd1-76c1-4d84-bbfd-bdd2e904190e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:08.210478 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-88f5ebd1-76c1-4d84-bbfd-bdd2e904190e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:08.211115 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-88f5ebd1-76c1-4d84-bbfd-bdd2e904190e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:08.420077 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-94fdd3d1-802b-4650-8311-e2f2cc2171e0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:08.421009 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-94fdd3d1-802b-4650-8311-e2f2cc2171e0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:08.459055 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-94fdd3d1-802b-4650-8311-e2f2cc2171e0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:08.459740 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-94fdd3d1-802b-4650-8311-e2f2cc2171e0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:08.461569 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-94fdd3d1-802b-4650-8311-e2f2cc2171e0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:08.464148 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-94fdd3d1-802b-4650-8311-e2f2cc2171e0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:08.530289 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-88f5ebd1-76c1-4d84-bbfd-bdd2e904190e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:08.542855 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-88f5ebd1-76c1-4d84-bbfd-bdd2e904190e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1522 microversion: 2.1 time: 0.347516 Jun 08 02:07:08.553672 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 106/204] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:08 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1522 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:08.765968 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-79c9842e-ddcc-42fc-8914-ddb83489b4ab tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:08.766841 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-79c9842e-ddcc-42fc-8914-ddb83489b4ab tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: 82829d3a-716e-45c0-8d9a-5f560b9b96a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:08.772823 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-79c9842e-ddcc-42fc-8914-ddb83489b4ab tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:08.774043 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-79c9842e-ddcc-42fc-8914-ddb83489b4ab tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:08.774968 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-79c9842e-ddcc-42fc-8914-ddb83489b4ab tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:08.775755 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-79c9842e-ddcc-42fc-8914-ddb83489b4ab tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:08.777058 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-94fdd3d1-802b-4650-8311-e2f2cc2171e0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:08.787698 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-94fdd3d1-802b-4650-8311-e2f2cc2171e0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:08.789925 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-94fdd3d1-802b-4650-8311-e2f2cc2171e0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:08.791446 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-94fdd3d1-802b-4650-8311-e2f2cc2171e0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1408 microversion: 2.20 time: 0.375837 Jun 08 02:07:08.805414 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 99/205] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:07:08 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1408 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:07:09.227277 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-79c9842e-ddcc-42fc-8914-ddb83489b4ab tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc19addacb9c412cb008e243c1fc7ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540c921edbf24dbeaf13675b583bb464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:09.240245 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-79c9842e-ddcc-42fc-8914-ddb83489b4ab tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6" status: 200 len: 1314 microversion: 2.1 time: 0.478909 Jun 08 02:07:09.244878 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 107/206] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:08 2022] GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6 => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:09.468891 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-6f24a4fd-4574-481e-97c6-07559769db82 req-fd19ed7d-8bef-4c41-aab8-6f4d93f48e99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82829d3a-716e-45c0-8d9a-5f560b9b96a6", "tag": "e4ca8bf7-ca3e-4666-8826-6b2e8ba7fec6"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:07:09.508858 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-6f24a4fd-4574-481e-97c6-07559769db82 req-fd19ed7d-8bef-4c41-aab8-6f4d93f48e99 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:09.509555 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-6f24a4fd-4574-481e-97c6-07559769db82 req-fd19ed7d-8bef-4c41-aab8-6f4d93f48e99 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:09.531943 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-6f24a4fd-4574-481e-97c6-07559769db82 req-fd19ed7d-8bef-4c41-aab8-6f4d93f48e99 service nova] Creating event network-changed:e4ca8bf7-ca3e-4666-8826-6b2e8ba7fec6 for instance 82829d3a-716e-45c0-8d9a-5f560b9b96a6 on hv-cinder-84506 Jun 08 02:07:09.540829 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-6f24a4fd-4574-481e-97c6-07559769db82 req-fd19ed7d-8bef-4c41-aab8-6f4d93f48e99 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075652 Jun 08 02:07:09.544647 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 100/207] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:07:09.559937 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-7564e126-c0cf-4c04-9a08-fa4a4e10660a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:09.560648 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-7564e126-c0cf-4c04-9a08-fa4a4e10660a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:09.568478 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7564e126-c0cf-4c04-9a08-fa4a4e10660a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:09.569731 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7564e126-c0cf-4c04-9a08-fa4a4e10660a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:09.571864 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7564e126-c0cf-4c04-9a08-fa4a4e10660a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:09.572826 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7564e126-c0cf-4c04-9a08-fa4a4e10660a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:09.578956 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:07:09.811841 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d3f709f1-1e86-45d8-afae-b72b8b15ce15 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:09.813097 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d3f709f1-1e86-45d8-afae-b72b8b15ce15 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:09.815453 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7564e126-c0cf-4c04-9a08-fa4a4e10660a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:09.821907 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d3f709f1-1e86-45d8-afae-b72b8b15ce15 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:09.822438 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d3f709f1-1e86-45d8-afae-b72b8b15ce15 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:09.823422 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d3f709f1-1e86-45d8-afae-b72b8b15ce15 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:09.824351 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d3f709f1-1e86-45d8-afae-b72b8b15ce15 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:09.825745 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-7564e126-c0cf-4c04-9a08-fa4a4e10660a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1522 microversion: 2.1 time: 0.269504 Jun 08 02:07:09.836883 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 108/208] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:09 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:10.057510 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d3f709f1-1e86-45d8-afae-b72b8b15ce15 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:10.067480 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d3f709f1-1e86-45d8-afae-b72b8b15ce15 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:10.069682 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d3f709f1-1e86-45d8-afae-b72b8b15ce15 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:10.070905 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d3f709f1-1e86-45d8-afae-b72b8b15ce15 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1408 microversion: 2.20 time: 0.264735 Jun 08 02:07:10.077773 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 101/209] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:07:09 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1408 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:07:10.261148 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-9af58b35-bdc6-4acc-a597-f2b8b7648418 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:10.261800 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-9af58b35-bdc6-4acc-a597-f2b8b7648418 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: 82829d3a-716e-45c0-8d9a-5f560b9b96a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:10.268006 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9af58b35-bdc6-4acc-a597-f2b8b7648418 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:10.268489 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9af58b35-bdc6-4acc-a597-f2b8b7648418 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:10.269241 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9af58b35-bdc6-4acc-a597-f2b8b7648418 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:10.270854 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9af58b35-bdc6-4acc-a597-f2b8b7648418 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:10.341579 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-7a81f9e6-e5bf-46da-bf31-1773d45d9e26 req-5c875c0a-8465-4ba7-aa5e-af5dce4bdac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7944f2e-2294-4a69-bd4e-d51f50e73e56", "name": "network-vif-plugged", "status": "completed", "tag": "4c178719-6047-43d9-9d57-30618b0b060e"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:07:10.354767 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-7a81f9e6-e5bf-46da-bf31-1773d45d9e26 req-5c875c0a-8465-4ba7-aa5e-af5dce4bdac7 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:10.355305 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-7a81f9e6-e5bf-46da-bf31-1773d45d9e26 req-5c875c0a-8465-4ba7-aa5e-af5dce4bdac7 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:10.367613 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-7a81f9e6-e5bf-46da-bf31-1773d45d9e26 req-5c875c0a-8465-4ba7-aa5e-af5dce4bdac7 service nova] Creating event network-vif-plugged:4c178719-6047-43d9-9d57-30618b0b060e for instance b7944f2e-2294-4a69-bd4e-d51f50e73e56 on hv-cinder-84506 Jun 08 02:07:10.373803 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-7a81f9e6-e5bf-46da-bf31-1773d45d9e26 req-5c875c0a-8465-4ba7-aa5e-af5dce4bdac7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037609 Jun 08 02:07:10.375031 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 102/210] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 02:07:10.422757 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-9af58b35-bdc6-4acc-a597-f2b8b7648418 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc19addacb9c412cb008e243c1fc7ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540c921edbf24dbeaf13675b583bb464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:10.430751 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-9af58b35-bdc6-4acc-a597-f2b8b7648418 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6" status: 200 len: 1314 microversion: 2.1 time: 0.173597 Jun 08 02:07:10.431293 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 109/211] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:10 2022] GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:10.844974 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4bccf3ce-7819-40d0-b60d-42d5a561cf0e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:10.845668 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4bccf3ce-7819-40d0-b60d-42d5a561cf0e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:10.852582 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4bccf3ce-7819-40d0-b60d-42d5a561cf0e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:10.853017 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4bccf3ce-7819-40d0-b60d-42d5a561cf0e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:10.853766 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4bccf3ce-7819-40d0-b60d-42d5a561cf0e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:10.854197 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4bccf3ce-7819-40d0-b60d-42d5a561cf0e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:11.002340 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4bccf3ce-7819-40d0-b60d-42d5a561cf0e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:11.012266 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4bccf3ce-7819-40d0-b60d-42d5a561cf0e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1522 microversion: 2.1 time: 0.171876 Jun 08 02:07:11.012797 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 103/212] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:10 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:11.089517 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-90d3b23e-8f7d-4e57-bb04-48268db4b75f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:11.090451 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-90d3b23e-8f7d-4e57-bb04-48268db4b75f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:11.099206 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-90d3b23e-8f7d-4e57-bb04-48268db4b75f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:11.099754 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-90d3b23e-8f7d-4e57-bb04-48268db4b75f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:11.100554 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-90d3b23e-8f7d-4e57-bb04-48268db4b75f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:11.100980 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-90d3b23e-8f7d-4e57-bb04-48268db4b75f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:11.396056 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-90d3b23e-8f7d-4e57-bb04-48268db4b75f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:11.406548 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-90d3b23e-8f7d-4e57-bb04-48268db4b75f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:11.408284 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-90d3b23e-8f7d-4e57-bb04-48268db4b75f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:11.409722 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-90d3b23e-8f7d-4e57-bb04-48268db4b75f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1408 microversion: 2.20 time: 0.324722 Jun 08 02:07:11.411713 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 110/213] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:07:11 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1408 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:07:11.447154 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3d82592e-ad9a-4716-9027-4fd47a7bc786 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:11.447971 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3d82592e-ad9a-4716-9027-4fd47a7bc786 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: 82829d3a-716e-45c0-8d9a-5f560b9b96a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:11.453908 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3d82592e-ad9a-4716-9027-4fd47a7bc786 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:11.454354 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3d82592e-ad9a-4716-9027-4fd47a7bc786 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:11.455129 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3d82592e-ad9a-4716-9027-4fd47a7bc786 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:11.455543 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3d82592e-ad9a-4716-9027-4fd47a7bc786 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:11.585784 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3d82592e-ad9a-4716-9027-4fd47a7bc786 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc19addacb9c412cb008e243c1fc7ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540c921edbf24dbeaf13675b583bb464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:11.593208 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3d82592e-ad9a-4716-9027-4fd47a7bc786 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6" status: 200 len: 1314 microversion: 2.1 time: 0.149969 Jun 08 02:07:11.593767 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 104/214] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:11 2022] GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:12.031232 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-7f3113d7-6f73-4760-9a46-fd0d5e24f774 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:12.031989 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-7f3113d7-6f73-4760-9a46-fd0d5e24f774 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:12.034267 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=4 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:07:12.042237 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7f3113d7-6f73-4760-9a46-fd0d5e24f774 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:12.042682 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7f3113d7-6f73-4760-9a46-fd0d5e24f774 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:12.043450 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7f3113d7-6f73-4760-9a46-fd0d5e24f774 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:12.043887 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7f3113d7-6f73-4760-9a46-fd0d5e24f774 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:12.179011 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7f3113d7-6f73-4760-9a46-fd0d5e24f774 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:12.186565 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-7f3113d7-6f73-4760-9a46-fd0d5e24f774 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1522 microversion: 2.1 time: 0.162122 Jun 08 02:07:12.187132 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 111/215] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:12 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:12.429605 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6348e907-745a-4973-8b56-fc5105baf6fb tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:12.430708 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6348e907-745a-4973-8b56-fc5105baf6fb tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:12.433437 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=4 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:07:12.434386 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=16 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:07:12.442975 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6348e907-745a-4973-8b56-fc5105baf6fb tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:12.449240 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6348e907-745a-4973-8b56-fc5105baf6fb tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:12.449971 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6348e907-745a-4973-8b56-fc5105baf6fb tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:12.450798 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6348e907-745a-4973-8b56-fc5105baf6fb tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:12.477671 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=100 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:07:12.613690 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f5de80fb-afa2-45f4-956c-2413c30c23d0 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:12.615405 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f5de80fb-afa2-45f4-956c-2413c30c23d0 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: 82829d3a-716e-45c0-8d9a-5f560b9b96a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:12.621901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f5de80fb-afa2-45f4-956c-2413c30c23d0 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:12.622348 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f5de80fb-afa2-45f4-956c-2413c30c23d0 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:12.623103 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f5de80fb-afa2-45f4-956c-2413c30c23d0 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:12.623525 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f5de80fb-afa2-45f4-956c-2413c30c23d0 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:12.646499 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6348e907-745a-4973-8b56-fc5105baf6fb tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:12.655941 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6348e907-745a-4973-8b56-fc5105baf6fb tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:12.657684 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6348e907-745a-4973-8b56-fc5105baf6fb tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:12.659206 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6348e907-745a-4973-8b56-fc5105baf6fb tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1408 microversion: 2.20 time: 0.234987 Jun 08 02:07:12.671162 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 105/216] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:07:12 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1408 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:07:12.822576 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f5de80fb-afa2-45f4-956c-2413c30c23d0 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc19addacb9c412cb008e243c1fc7ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540c921edbf24dbeaf13675b583bb464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:12.832426 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f5de80fb-afa2-45f4-956c-2413c30c23d0 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6" status: 200 len: 1314 microversion: 2.1 time: 0.225498 Jun 08 02:07:12.840953 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 112/217] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:12 2022] GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:07:13.203156 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0d4e36f4-d34b-4a9b-9ea4-62cdd1b997f6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:13.203634 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0d4e36f4-d34b-4a9b-9ea4-62cdd1b997f6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:13.211612 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0d4e36f4-d34b-4a9b-9ea4-62cdd1b997f6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:13.212054 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0d4e36f4-d34b-4a9b-9ea4-62cdd1b997f6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:13.212851 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0d4e36f4-d34b-4a9b-9ea4-62cdd1b997f6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:13.213281 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0d4e36f4-d34b-4a9b-9ea4-62cdd1b997f6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:13.397480 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0d4e36f4-d34b-4a9b-9ea4-62cdd1b997f6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:13.405273 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0d4e36f4-d34b-4a9b-9ea4-62cdd1b997f6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1522 microversion: 2.1 time: 0.206059 Jun 08 02:07:13.405849 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 106/218] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:13 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:13.679015 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-7b8a9485-e0a0-4cb4-9f10-13f7de408411 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:13.679731 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-7b8a9485-e0a0-4cb4-9f10-13f7de408411 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:13.685643 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7b8a9485-e0a0-4cb4-9f10-13f7de408411 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:13.686083 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7b8a9485-e0a0-4cb4-9f10-13f7de408411 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:13.686835 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7b8a9485-e0a0-4cb4-9f10-13f7de408411 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:13.687261 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7b8a9485-e0a0-4cb4-9f10-13f7de408411 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:13.842146 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7b8a9485-e0a0-4cb4-9f10-13f7de408411 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:13.850384 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e8e26f0a-b3a7-47c2-bc94-256dddc60906 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:13.851028 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e8e26f0a-b3a7-47c2-bc94-256dddc60906 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: 82829d3a-716e-45c0-8d9a-5f560b9b96a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:13.857629 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e8e26f0a-b3a7-47c2-bc94-256dddc60906 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:13.858271 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e8e26f0a-b3a7-47c2-bc94-256dddc60906 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:13.859316 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e8e26f0a-b3a7-47c2-bc94-256dddc60906 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:13.859895 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e8e26f0a-b3a7-47c2-bc94-256dddc60906 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:13.862503 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7b8a9485-e0a0-4cb4-9f10-13f7de408411 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:13.865093 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7b8a9485-e0a0-4cb4-9f10-13f7de408411 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:13.868092 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-7b8a9485-e0a0-4cb4-9f10-13f7de408411 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1599 microversion: 2.20 time: 0.192759 Jun 08 02:07:13.870577 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 113/219] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:07:13 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1599 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:07:13.890876 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a8be7fcc-cfef-4047-8481-00c8f54c7207 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:13.891647 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a8be7fcc-cfef-4047-8481-00c8f54c7207 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:13.899600 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a8be7fcc-cfef-4047-8481-00c8f54c7207 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:13.900142 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a8be7fcc-cfef-4047-8481-00c8f54c7207 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:13.901185 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a8be7fcc-cfef-4047-8481-00c8f54c7207 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:13.901616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a8be7fcc-cfef-4047-8481-00c8f54c7207 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:14.024150 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a8be7fcc-cfef-4047-8481-00c8f54c7207 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.139227 Jun 08 02:07:14.024924 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 114/220] 10.222.0.20 () {60 vars in 1315 bytes} [Wed Jun 8 02:07:13 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56/os-interface => generated 284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 08 02:07:14.073704 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e8e26f0a-b3a7-47c2-bc94-256dddc60906 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc19addacb9c412cb008e243c1fc7ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540c921edbf24dbeaf13675b583bb464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:14.082851 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e8e26f0a-b3a7-47c2-bc94-256dddc60906 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6" status: 200 len: 1314 microversion: 2.1 time: 0.236261 Jun 08 02:07:14.092477 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 107/221] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:13 2022] GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:07:14.423655 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-af7b6637-e458-45ff-93a6-4c52849c9287 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:14.424591 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-af7b6637-e458-45ff-93a6-4c52849c9287 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:14.437656 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-af7b6637-e458-45ff-93a6-4c52849c9287 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:14.438357 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-af7b6637-e458-45ff-93a6-4c52849c9287 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:14.439302 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-af7b6637-e458-45ff-93a6-4c52849c9287 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:14.439919 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-af7b6637-e458-45ff-93a6-4c52849c9287 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:14.669155 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-af7b6637-e458-45ff-93a6-4c52849c9287 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:14.678619 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-af7b6637-e458-45ff-93a6-4c52849c9287 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1522 microversion: 2.1 time: 0.259231 Jun 08 02:07:14.679454 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 115/222] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:14 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:15.100164 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-bd0b2693-6720-447c-b1a4-4efb1a67c807 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:15.100808 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-bd0b2693-6720-447c-b1a4-4efb1a67c807 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: 82829d3a-716e-45c0-8d9a-5f560b9b96a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:15.107591 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bd0b2693-6720-447c-b1a4-4efb1a67c807 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:15.108041 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bd0b2693-6720-447c-b1a4-4efb1a67c807 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:15.108836 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bd0b2693-6720-447c-b1a4-4efb1a67c807 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:15.109442 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bd0b2693-6720-447c-b1a4-4efb1a67c807 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:15.274310 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-5363336f-6c76-4d9d-82d6-4965106e5b57 req-d9356309-5b5a-41e7-a78e-a45df3143dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7944f2e-2294-4a69-bd4e-d51f50e73e56", "tag": "4c178719-6047-43d9-9d57-30618b0b060e"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:07:15.283656 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-bd0b2693-6720-447c-b1a4-4efb1a67c807 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc19addacb9c412cb008e243c1fc7ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540c921edbf24dbeaf13675b583bb464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:15.293745 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-bd0b2693-6720-447c-b1a4-4efb1a67c807 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6" status: 200 len: 1314 microversion: 2.1 time: 0.197992 Jun 08 02:07:15.294322 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 108/223] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:15 2022] GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:15.297261 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-5363336f-6c76-4d9d-82d6-4965106e5b57 req-d9356309-5b5a-41e7-a78e-a45df3143dc9 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:15.297698 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-5363336f-6c76-4d9d-82d6-4965106e5b57 req-d9356309-5b5a-41e7-a78e-a45df3143dc9 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:15.310528 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-5363336f-6c76-4d9d-82d6-4965106e5b57 req-d9356309-5b5a-41e7-a78e-a45df3143dc9 service nova] Creating event network-changed:4c178719-6047-43d9-9d57-30618b0b060e for instance b7944f2e-2294-4a69-bd4e-d51f50e73e56 on hv-cinder-84506 Jun 08 02:07:15.316678 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-5363336f-6c76-4d9d-82d6-4965106e5b57 req-d9356309-5b5a-41e7-a78e-a45df3143dc9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046713 Jun 08 02:07:15.317322 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 116/224] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:07:15.701544 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-fa8f8d89-029e-4693-95b8-10a6eb546424 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:15.702496 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-fa8f8d89-029e-4693-95b8-10a6eb546424 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:15.713054 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fa8f8d89-029e-4693-95b8-10a6eb546424 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:15.714244 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fa8f8d89-029e-4693-95b8-10a6eb546424 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:15.715250 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fa8f8d89-029e-4693-95b8-10a6eb546424 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:15.715895 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fa8f8d89-029e-4693-95b8-10a6eb546424 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:16.044644 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fa8f8d89-029e-4693-95b8-10a6eb546424 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:16.049799 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-fa8f8d89-029e-4693-95b8-10a6eb546424 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1522 microversion: 2.1 time: 0.354665 Jun 08 02:07:16.051446 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 109/225] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:15 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1522 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:16.312972 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-3c1ea6e6-f443-4893-930d-544505cda638 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:16.314337 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-3c1ea6e6-f443-4893-930d-544505cda638 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: 82829d3a-716e-45c0-8d9a-5f560b9b96a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:16.327619 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3c1ea6e6-f443-4893-930d-544505cda638 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:16.328298 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3c1ea6e6-f443-4893-930d-544505cda638 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:16.329500 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3c1ea6e6-f443-4893-930d-544505cda638 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:16.331276 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3c1ea6e6-f443-4893-930d-544505cda638 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:16.382796 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-374315d0-10a6-44a2-a4a8-4438c9a5c6e7 req-8b014cb9-9b95-431a-bb06-4363906f681c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82829d3a-716e-45c0-8d9a-5f560b9b96a6", "name": "network-vif-plugged", "status": "completed", "tag": "e4ca8bf7-ca3e-4666-8826-6b2e8ba7fec6"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:07:16.396923 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-374315d0-10a6-44a2-a4a8-4438c9a5c6e7 req-8b014cb9-9b95-431a-bb06-4363906f681c service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:16.397742 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-374315d0-10a6-44a2-a4a8-4438c9a5c6e7 req-8b014cb9-9b95-431a-bb06-4363906f681c service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:16.424949 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-374315d0-10a6-44a2-a4a8-4438c9a5c6e7 req-8b014cb9-9b95-431a-bb06-4363906f681c service nova] Creating event network-vif-plugged:e4ca8bf7-ca3e-4666-8826-6b2e8ba7fec6 for instance 82829d3a-716e-45c0-8d9a-5f560b9b96a6 on hv-cinder-84506 Jun 08 02:07:16.437741 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-374315d0-10a6-44a2-a4a8-4438c9a5c6e7 req-8b014cb9-9b95-431a-bb06-4363906f681c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060018 Jun 08 02:07:16.439406 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 110/226] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 02:07:16.621641 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-3c1ea6e6-f443-4893-930d-544505cda638 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc19addacb9c412cb008e243c1fc7ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540c921edbf24dbeaf13675b583bb464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:16.630268 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-3c1ea6e6-f443-4893-930d-544505cda638 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6" status: 200 len: 1314 microversion: 2.1 time: 0.322165 Jun 08 02:07:16.630838 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 117/227] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:16 2022] GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:17.070333 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d8025b7b-0ad1-4db7-ac1e-525be642d573 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:17.071435 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d8025b7b-0ad1-4db7-ac1e-525be642d573 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:17.080114 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d8025b7b-0ad1-4db7-ac1e-525be642d573 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:17.080805 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d8025b7b-0ad1-4db7-ac1e-525be642d573 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:17.081588 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d8025b7b-0ad1-4db7-ac1e-525be642d573 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:17.082237 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d8025b7b-0ad1-4db7-ac1e-525be642d573 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:17.226074 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d8025b7b-0ad1-4db7-ac1e-525be642d573 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:17.233960 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d8025b7b-0ad1-4db7-ac1e-525be642d573 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1522 microversion: 2.1 time: 0.170604 Jun 08 02:07:17.234532 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 111/228] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:17 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:17.647590 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-019a8086-7dc3-4202-81c5-aadb08c1f7ef tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:17.648246 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-019a8086-7dc3-4202-81c5-aadb08c1f7ef tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: 82829d3a-716e-45c0-8d9a-5f560b9b96a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:17.658620 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-019a8086-7dc3-4202-81c5-aadb08c1f7ef tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:17.659069 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-019a8086-7dc3-4202-81c5-aadb08c1f7ef tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:17.660144 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-019a8086-7dc3-4202-81c5-aadb08c1f7ef tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:17.660621 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-019a8086-7dc3-4202-81c5-aadb08c1f7ef tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:17.821463 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-019a8086-7dc3-4202-81c5-aadb08c1f7ef tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc19addacb9c412cb008e243c1fc7ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540c921edbf24dbeaf13675b583bb464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:17.832024 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-019a8086-7dc3-4202-81c5-aadb08c1f7ef tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6" status: 200 len: 1314 microversion: 2.1 time: 0.188486 Jun 08 02:07:17.832797 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 118/229] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:17 2022] GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:07:18.091198 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a13fbdd9-4cf2-411b-8833-d80b3affdf16 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:18.091935 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a13fbdd9-4cf2-411b-8833-d80b3affdf16 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:18.098786 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a13fbdd9-4cf2-411b-8833-d80b3affdf16 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:18.099231 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a13fbdd9-4cf2-411b-8833-d80b3affdf16 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:18.099988 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a13fbdd9-4cf2-411b-8833-d80b3affdf16 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:18.100733 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a13fbdd9-4cf2-411b-8833-d80b3affdf16 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:18.127274 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a13fbdd9-4cf2-411b-8833-d80b3affdf16 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380/ips" status: 200 len: 147 microversion: 2.1 time: 0.039776 Jun 08 02:07:18.132807 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 112/230] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Jun 8 02:07:18 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380/ips => generated 147 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:07:18.251245 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-abba0601-dbb4-4e5c-a0c6-0ab57d17f6ba tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:18.252129 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-abba0601-dbb4-4e5c-a0c6-0ab57d17f6ba tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:18.259450 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-abba0601-dbb4-4e5c-a0c6-0ab57d17f6ba tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:18.260151 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-abba0601-dbb4-4e5c-a0c6-0ab57d17f6ba tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:18.260949 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-abba0601-dbb4-4e5c-a0c6-0ab57d17f6ba tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:18.262034 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-abba0601-dbb4-4e5c-a0c6-0ab57d17f6ba tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:18.403120 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-abba0601-dbb4-4e5c-a0c6-0ab57d17f6ba tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:18.412749 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-abba0601-dbb4-4e5c-a0c6-0ab57d17f6ba tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1522 microversion: 2.1 time: 0.165526 Jun 08 02:07:18.422337 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 119/231] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:18 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:18.849906 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ddea0cb2-5ac4-4c93-b983-60497dc1f8a8 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:18.851499 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ddea0cb2-5ac4-4c93-b983-60497dc1f8a8 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: 82829d3a-716e-45c0-8d9a-5f560b9b96a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:18.858622 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ddea0cb2-5ac4-4c93-b983-60497dc1f8a8 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:18.859067 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ddea0cb2-5ac4-4c93-b983-60497dc1f8a8 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:18.859819 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ddea0cb2-5ac4-4c93-b983-60497dc1f8a8 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:18.860244 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ddea0cb2-5ac4-4c93-b983-60497dc1f8a8 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:18.997153 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ddea0cb2-5ac4-4c93-b983-60497dc1f8a8 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc19addacb9c412cb008e243c1fc7ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540c921edbf24dbeaf13675b583bb464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:19.005548 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ddea0cb2-5ac4-4c93-b983-60497dc1f8a8 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6" status: 200 len: 1497 microversion: 2.1 time: 0.161064 Jun 08 02:07:19.006106 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 113/232] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:18 2022] GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6 => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:19.430413 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-53aec064-a9a7-4d83-858f-382e1f1c2434 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:19.431229 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-53aec064-a9a7-4d83-858f-382e1f1c2434 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:19.441377 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-53aec064-a9a7-4d83-858f-382e1f1c2434 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:19.441829 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-53aec064-a9a7-4d83-858f-382e1f1c2434 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:19.443712 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-53aec064-a9a7-4d83-858f-382e1f1c2434 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:19.444158 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-53aec064-a9a7-4d83-858f-382e1f1c2434 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:19.594188 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-53aec064-a9a7-4d83-858f-382e1f1c2434 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:19.602107 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-53aec064-a9a7-4d83-858f-382e1f1c2434 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1522 microversion: 2.1 time: 0.176927 Jun 08 02:07:19.602675 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 120/233] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:19 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:19.625497 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d8c0abaa-65a7-45ee-aa18-4b7b3a5a2899 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:19.626028 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d8c0abaa-65a7-45ee-aa18-4b7b3a5a2899 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: 82829d3a-716e-45c0-8d9a-5f560b9b96a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:19.633197 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d8c0abaa-65a7-45ee-aa18-4b7b3a5a2899 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:19.633642 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d8c0abaa-65a7-45ee-aa18-4b7b3a5a2899 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:19.634411 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d8c0abaa-65a7-45ee-aa18-4b7b3a5a2899 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:19.634836 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d8c0abaa-65a7-45ee-aa18-4b7b3a5a2899 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:19.660853 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d8c0abaa-65a7-45ee-aa18-4b7b3a5a2899 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: 82829d3a-716e-45c0-8d9a-5f560b9b96a6] Going to try to terminate instance {{(pid=117938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 02:07:19.759488 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d8c0abaa-65a7-45ee-aa18-4b7b3a5a2899 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "DELETE /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6" status: 204 len: 0 microversion: 2.1 time: 0.137626 Jun 08 02:07:19.760296 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 114/234] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jun 8 02:07:19 2022] DELETE /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 08 02:07:19.772090 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-9212edc6-cf3a-493b-b0a9-e78d0d62b879 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:19.774058 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-9212edc6-cf3a-493b-b0a9-e78d0d62b879 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: 82829d3a-716e-45c0-8d9a-5f560b9b96a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:19.781996 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9212edc6-cf3a-493b-b0a9-e78d0d62b879 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:19.782859 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9212edc6-cf3a-493b-b0a9-e78d0d62b879 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:19.783852 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9212edc6-cf3a-493b-b0a9-e78d0d62b879 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:19.785233 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9212edc6-cf3a-493b-b0a9-e78d0d62b879 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:19.939072 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-9212edc6-cf3a-493b-b0a9-e78d0d62b879 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc19addacb9c412cb008e243c1fc7ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540c921edbf24dbeaf13675b583bb464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:19.946884 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-9212edc6-cf3a-493b-b0a9-e78d0d62b879 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6" status: 200 len: 1503 microversion: 2.1 time: 0.182590 Jun 08 02:07:19.947655 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 121/235] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:19 2022] GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6 => generated 1503 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:20.619860 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-75b0fb96-f720-40dd-bce0-a02a708942f6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:20.620863 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-75b0fb96-f720-40dd-bce0-a02a708942f6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:20.623619 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:07:20.629606 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-75b0fb96-f720-40dd-bce0-a02a708942f6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:20.630218 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-75b0fb96-f720-40dd-bce0-a02a708942f6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:20.630939 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-75b0fb96-f720-40dd-bce0-a02a708942f6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:20.631375 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-75b0fb96-f720-40dd-bce0-a02a708942f6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:20.798722 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-75b0fb96-f720-40dd-bce0-a02a708942f6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:20.806253 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-75b0fb96-f720-40dd-bce0-a02a708942f6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1522 microversion: 2.1 time: 0.190569 Jun 08 02:07:20.806804 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 115/236] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:20 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:20.964843 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-17bbdc10-8932-4adb-910a-0191301c9a39 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:20.965443 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-17bbdc10-8932-4adb-910a-0191301c9a39 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: 82829d3a-716e-45c0-8d9a-5f560b9b96a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:20.971350 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-17bbdc10-8932-4adb-910a-0191301c9a39 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:20.971788 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-17bbdc10-8932-4adb-910a-0191301c9a39 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:20.973094 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-17bbdc10-8932-4adb-910a-0191301c9a39 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:20.973514 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-17bbdc10-8932-4adb-910a-0191301c9a39 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:21.101239 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-17bbdc10-8932-4adb-910a-0191301c9a39 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc19addacb9c412cb008e243c1fc7ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540c921edbf24dbeaf13675b583bb464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:21.108925 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-17bbdc10-8932-4adb-910a-0191301c9a39 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6" status: 200 len: 1503 microversion: 2.1 time: 0.148260 Jun 08 02:07:21.109494 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 122/237] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:20 2022] GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6 => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:21.499081 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b9fbbabf-4395-4b5a-bc57-b2d6c309dc72 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8530e044-f3bd-4a15-a839-61e412c2cdd6"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:07:21.500320 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b9fbbabf-4395-4b5a-bc57-b2d6c309dc72 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:21.507006 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b9fbbabf-4395-4b5a-bc57-b2d6c309dc72 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:21.507443 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b9fbbabf-4395-4b5a-bc57-b2d6c309dc72 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:21.508197 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b9fbbabf-4395-4b5a-bc57-b2d6c309dc72 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:21.508652 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b9fbbabf-4395-4b5a-bc57-b2d6c309dc72 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:21.822864 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-145a9335-82a8-469b-a6a6-99811d6cc609 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:21.823644 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-145a9335-82a8-469b-a6a6-99811d6cc609 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:21.829801 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-145a9335-82a8-469b-a6a6-99811d6cc609 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:21.830241 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-145a9335-82a8-469b-a6a6-99811d6cc609 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:21.831001 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-145a9335-82a8-469b-a6a6-99811d6cc609 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:21.831467 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-145a9335-82a8-469b-a6a6-99811d6cc609 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:21.978421 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-145a9335-82a8-469b-a6a6-99811d6cc609 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:21.986956 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-145a9335-82a8-469b-a6a6-99811d6cc609 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1522 microversion: 2.1 time: 0.167934 Jun 08 02:07:21.987583 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 123/238] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:21 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:07:22.126552 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2711d7a3-469d-49bf-96f4-590f48ede100 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:22.127163 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-2711d7a3-469d-49bf-96f4-590f48ede100 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: 82829d3a-716e-45c0-8d9a-5f560b9b96a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:22.134102 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2711d7a3-469d-49bf-96f4-590f48ede100 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:22.134556 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2711d7a3-469d-49bf-96f4-590f48ede100 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:22.135344 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2711d7a3-469d-49bf-96f4-590f48ede100 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:22.135778 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2711d7a3-469d-49bf-96f4-590f48ede100 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:22.262300 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2711d7a3-469d-49bf-96f4-590f48ede100 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc19addacb9c412cb008e243c1fc7ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540c921edbf24dbeaf13675b583bb464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:22.270456 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2711d7a3-469d-49bf-96f4-590f48ede100 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6" status: 200 len: 1503 microversion: 2.1 time: 0.147828 Jun 08 02:07:22.271016 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 124/239] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:22 2022] GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6 => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:07:23.005399 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ea30e3a1-e327-4fa5-bd59-b7344327ee0c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:23.006049 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ea30e3a1-e327-4fa5-bd59-b7344327ee0c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:23.011919 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ea30e3a1-e327-4fa5-bd59-b7344327ee0c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:23.012367 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ea30e3a1-e327-4fa5-bd59-b7344327ee0c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:23.013151 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ea30e3a1-e327-4fa5-bd59-b7344327ee0c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:23.013582 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ea30e3a1-e327-4fa5-bd59-b7344327ee0c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:23.141998 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ea30e3a1-e327-4fa5-bd59-b7344327ee0c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:23.144384 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=100 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:07:23.151442 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ea30e3a1-e327-4fa5-bd59-b7344327ee0c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1522 microversion: 2.1 time: 0.150474 Jun 08 02:07:23.152010 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 125/240] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:22 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:07:23.288601 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e432db9d-89e1-4388-8d22-8ba063468af8 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:23.289197 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e432db9d-89e1-4388-8d22-8ba063468af8 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: 82829d3a-716e-45c0-8d9a-5f560b9b96a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:23.295027 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e432db9d-89e1-4388-8d22-8ba063468af8 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:23.295464 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e432db9d-89e1-4388-8d22-8ba063468af8 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:23.296200 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e432db9d-89e1-4388-8d22-8ba063468af8 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:23.296659 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e432db9d-89e1-4388-8d22-8ba063468af8 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:23.424671 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e432db9d-89e1-4388-8d22-8ba063468af8 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc19addacb9c412cb008e243c1fc7ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540c921edbf24dbeaf13675b583bb464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:23.432687 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e432db9d-89e1-4388-8d22-8ba063468af8 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6" status: 200 len: 1503 microversion: 2.1 time: 0.149272 Jun 08 02:07:23.433249 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 126/241] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:23 2022] GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6 => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:07:24.171895 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-cd3fb80a-e0df-4c46-ba94-471ab9145ff3 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:24.172640 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-cd3fb80a-e0df-4c46-ba94-471ab9145ff3 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:24.185349 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=78 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:07:24.189082 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cd3fb80a-e0df-4c46-ba94-471ab9145ff3 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:24.189525 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cd3fb80a-e0df-4c46-ba94-471ab9145ff3 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:24.190400 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cd3fb80a-e0df-4c46-ba94-471ab9145ff3 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:24.191327 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cd3fb80a-e0df-4c46-ba94-471ab9145ff3 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:24.223838 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b9fbbabf-4395-4b5a-bc57-b2d6c309dc72 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "POST /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.728560 Jun 08 02:07:24.225467 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 116/242] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jun 8 02:07:21 2022] POST /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380/os-volume_attachments => generated 194 bytes in 2731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:07:24.449961 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-72551e02-c49f-4be1-96dc-5c59c0b87383 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:24.450632 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-72551e02-c49f-4be1-96dc-5c59c0b87383 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: 82829d3a-716e-45c0-8d9a-5f560b9b96a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:24.458179 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-72551e02-c49f-4be1-96dc-5c59c0b87383 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:24.458763 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-72551e02-c49f-4be1-96dc-5c59c0b87383 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:24.459644 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-72551e02-c49f-4be1-96dc-5c59c0b87383 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:24.460215 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-72551e02-c49f-4be1-96dc-5c59c0b87383 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:24.728746 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-cd3fb80a-e0df-4c46-ba94-471ab9145ff3 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:24.736762 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-cd3fb80a-e0df-4c46-ba94-471ab9145ff3 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1522 microversion: 2.1 time: 0.571251 Jun 08 02:07:24.737396 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 127/243] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:24 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1522 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:07:24.768463 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-72551e02-c49f-4be1-96dc-5c59c0b87383 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc19addacb9c412cb008e243c1fc7ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540c921edbf24dbeaf13675b583bb464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:24.776970 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-72551e02-c49f-4be1-96dc-5c59c0b87383 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6" status: 200 len: 1503 microversion: 2.1 time: 0.331721 Jun 08 02:07:24.777540 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 117/244] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:24 2022] GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6 => generated 1503 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:07:25.071046 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-f47f6839-b058-404e-a269-e618ebeb9cdb req-b907d026-5b82-4ec2-891a-f32d75b906b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82829d3a-716e-45c0-8d9a-5f560b9b96a6", "name": "network-vif-deleted", "tag": "e4ca8bf7-ca3e-4666-8826-6b2e8ba7fec6"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:07:25.079193 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-f47f6839-b058-404e-a269-e618ebeb9cdb req-b907d026-5b82-4ec2-891a-f32d75b906b3 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:25.079626 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-f47f6839-b058-404e-a269-e618ebeb9cdb req-b907d026-5b82-4ec2-891a-f32d75b906b3 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:25.091218 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-f47f6839-b058-404e-a269-e618ebeb9cdb req-b907d026-5b82-4ec2-891a-f32d75b906b3 service nova] Creating event network-vif-deleted:e4ca8bf7-ca3e-4666-8826-6b2e8ba7fec6 for instance 82829d3a-716e-45c0-8d9a-5f560b9b96a6 on hv-cinder-84506 Jun 08 02:07:25.096720 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-f47f6839-b058-404e-a269-e618ebeb9cdb req-b907d026-5b82-4ec2-891a-f32d75b906b3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029054 Jun 08 02:07:25.097526 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 128/245] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:07:25.755919 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-279d4ae7-610d-4eb4-b3f8-017743a772be tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:25.756684 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-279d4ae7-610d-4eb4-b3f8-017743a772be tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:25.763521 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-279d4ae7-610d-4eb4-b3f8-017743a772be tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:25.763973 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-279d4ae7-610d-4eb4-b3f8-017743a772be tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:25.764765 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-279d4ae7-610d-4eb4-b3f8-017743a772be tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:25.765202 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-279d4ae7-610d-4eb4-b3f8-017743a772be tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:25.795105 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-60a9b227-409b-4b45-897c-d0d15e1e92e1 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:25.795896 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-60a9b227-409b-4b45-897c-d0d15e1e92e1 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: 82829d3a-716e-45c0-8d9a-5f560b9b96a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:25.803625 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-60a9b227-409b-4b45-897c-d0d15e1e92e1 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:25.804548 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-60a9b227-409b-4b45-897c-d0d15e1e92e1 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:25.805390 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-60a9b227-409b-4b45-897c-d0d15e1e92e1 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:25.805894 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-60a9b227-409b-4b45-897c-d0d15e1e92e1 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:25.824128 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-60a9b227-409b-4b45-897c-d0d15e1e92e1 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] HTTP exception thrown: Instance 82829d3a-716e-45c0-8d9a-5f560b9b96a6 could not be found. Jun 08 02:07:25.828844 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-60a9b227-409b-4b45-897c-d0d15e1e92e1 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Request method failure captured: Jun 08 02:07:25.828844 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6 HTTP/1.1 Jun 08 02:07:25.828844 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept: application/json Jun 08 02:07:25.828844 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jun 08 02:07:25.828844 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Connection: close Jun 08 02:07:25.828844 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jun 08 02:07:25.828844 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jun 08 02:07:25.828844 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Host: 10.222.0.20 Jun 08 02:07:25.828844 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jun 08 02:07:25.828844 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jun 08 02:07:25.828844 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABioARCD3gC4Xf_eJlLYUE2JIJEjuOp2ZbSIV0mB4djau1C4NKml2Bt1nVSUoCyWrHqv6kVdrr8cFE7QmNnx71CC-8sSIqMbGjPx2ZbY3F8aRxJAsmAN_45zUkba7lxfpU2N_MjCL19z491fm_j3X06BpSlvve2gXnnV7wU-OzT2y8GXp8 Jun 08 02:07:25.828844 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jun 08 02:07:25.828844 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jun 08 02:07:25.828844 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jun 08 02:07:25.828844 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jun 08 02:07:25.828844 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jun 08 02:07:25.828844 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jun 08 02:07:25.828844 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Id: 540c921edbf24dbeaf13675b583bb464 Jun 08 02:07:25.828844 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-VolumesActionsTest-1280891985 Jun 08 02:07:25.828844 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jun 08 02:07:25.828844 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jun 08 02:07:25.830527 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/540c921edbf24dbeaf13675b583bb464"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_540c921edbf24dbeaf13675b583bb464", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/540c921edbf24dbeaf13675b583bb464"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/540c921edbf24dbeaf13675b583bb464"}]}] Jun 08 02:07:25.830527 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-VolumesActionsTest-1280891985 Jun 08 02:07:25.830527 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 540c921edbf24dbeaf13675b583bb464 Jun 08 02:07:25.830527 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-VolumesActionsTest-1280891985 Jun 08 02:07:25.830527 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User: tempest-VolumesActionsTest-1280891985-project Jun 08 02:07:25.830527 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jun 08 02:07:25.830527 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jun 08 02:07:25.830527 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Id: cc19addacb9c412cb008e243c1fc7ace Jun 08 02:07:25.830527 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-VolumesActionsTest-1280891985-project Jun 08 02:07:25.830527 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: method: > Jun 08 02:07:25.830527 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: exception: Instance 82829d3a-716e-45c0-8d9a-5f560b9b96a6 could not be found. Jun 08 02:07:25.830527 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: action_args: {'id': '82829d3a-716e-45c0-8d9a-5f560b9b96a6'} Jun 08 02:07:25.832117 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:07:25.832117 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:07:25.832117 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:07:25.832117 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:07:25.832117 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:07:25.832117 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:07:25.832117 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:07:25.832117 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:07:25.832117 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:07:25.832117 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:07:25.832117 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82829d3a-716e-45c0-8d9a-5f560b9b96a6 could not be found. Jun 08 02:07:25.832117 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:07:25.832117 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:07:25.832117 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:07:25.832117 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:07:25.832117 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:07:25.832117 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:07:25.832117 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:07:25.832117 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:07:25.832117 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:07:25.834400 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:07:25.834400 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 02:07:25.834400 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 02:07:25.834400 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:07:25.834400 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:07:25.834400 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:07:25.834400 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:07:25.834400 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82829d3a-716e-45c0-8d9a-5f560b9b96a6 could not be found. Jun 08 02:07:25.834400 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:07:25.834400 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:07:25.834400 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:07:25.834400 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:07:25.834400 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:07:25.834400 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:07:25.834400 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:07:25.834400 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:07:25.834400 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82829d3a-716e-45c0-8d9a-5f560b9b96a6 could not be found. Jun 08 02:07:25.834400 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:07:25.837053 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-60a9b227-409b-4b45-897c-d0d15e1e92e1 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Returning 404 to user: Instance 82829d3a-716e-45c0-8d9a-5f560b9b96a6 could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:07:25.838248 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-60a9b227-409b-4b45-897c-d0d15e1e92e1 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6" status: 404 len: 111 microversion: 2.1 time: 0.048066 Jun 08 02:07:25.838956 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 129/246] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:25 2022] GET /compute/v2.1/servers/82829d3a-716e-45c0-8d9a-5f560b9b96a6 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 08 02:07:25.924456 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-279d4ae7-610d-4eb4-b3f8-017743a772be tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:25.934593 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-279d4ae7-610d-4eb4-b3f8-017743a772be tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1522 microversion: 2.1 time: 0.184902 Jun 08 02:07:25.945140 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 118/247] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:25 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:25.967700 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c6b18801-3961-42b4-9e1e-9de26dc5d860 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-784452341", "imageRef": "e648e482-e374-429d-8152-a4a63797f314", "flavorRef": "452", "networks": [{"uuid": "8a44e4e9-cba1-44cd-ba3b-400779da1d15"}]}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:07:26.029379 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.network.neutron [None req-c6b18801-3961-42b4-9e1e-9de26dc5d860 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] validate_networks() for [('8a44e4e9-cba1-44cd-ba3b-400779da1d15', None, None, None, None, None)] {{(pid=117939) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 02:07:26.495374 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-c6b18801-3961-42b4-9e1e-9de26dc5d860 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Flavor limits 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 02:07:26.495966 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-c6b18801-3961-42b4-9e1e-9de26dc5d860 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Image limits 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 02:07:26.496739 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-c6b18801-3961-42b4-9e1e-9de26dc5d860 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Flavor pref 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 02:07:26.497771 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-c6b18801-3961-42b4-9e1e-9de26dc5d860 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Image pref 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 02:07:26.498569 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-c6b18801-3961-42b4-9e1e-9de26dc5d860 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 02:07:26.510677 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c6b18801-3961-42b4-9e1e-9de26dc5d860 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:26.511120 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c6b18801-3961-42b4-9e1e-9de26dc5d860 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:26.511903 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c6b18801-3961-42b4-9e1e-9de26dc5d860 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:26.512325 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c6b18801-3961-42b4-9e1e-9de26dc5d860 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:26.537494 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-c6b18801-3961-42b4-9e1e-9de26dc5d860 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Getting quotas for project 540c921edbf24dbeaf13675b583bb464. Resources: {'cores', 'ram', 'instances'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 02:07:26.542227 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-c6b18801-3961-42b4-9e1e-9de26dc5d860 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Getting quotas for user cc19addacb9c412cb008e243c1fc7ace and project 540c921edbf24dbeaf13675b583bb464. Resources: {'cores', 'ram', 'instances'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 02:07:26.565052 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c6b18801-3961-42b4-9e1e-9de26dc5d860 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Going to run 1 instances... {{(pid=117939) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 02:07:26.568346 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c6b18801-3961-42b4-9e1e-9de26dc5d860 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: aa8e11a7-f659-4bd6-a2ad-3327d14d3706] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e648e482-e374-429d-8152-a4a63797f314',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 02:07:26.627500 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c6b18801-3961-42b4-9e1e-9de26dc5d860 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.663875 Jun 08 02:07:26.629321 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 130/248] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jun 8 02:07:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 08 02:07:26.639397 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ca83e484-d253-44e0-bfe5-3baab985b32f tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:26.640068 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ca83e484-d253-44e0-bfe5-3baab985b32f tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: aa8e11a7-f659-4bd6-a2ad-3327d14d3706] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:26.709592 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ca83e484-d253-44e0-bfe5-3baab985b32f tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc19addacb9c412cb008e243c1fc7ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540c921edbf24dbeaf13675b583bb464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:26.716223 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ca83e484-d253-44e0-bfe5-3baab985b32f tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706" status: 200 len: 1213 microversion: 2.1 time: 0.081045 Jun 08 02:07:26.717161 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 119/249] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:26 2022] GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:26.953392 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-eb7bf459-6b19-4b11-8333-583778ae6b49 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:26.955116 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-eb7bf459-6b19-4b11-8333-583778ae6b49 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:26.963145 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eb7bf459-6b19-4b11-8333-583778ae6b49 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:26.963836 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eb7bf459-6b19-4b11-8333-583778ae6b49 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:26.965457 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eb7bf459-6b19-4b11-8333-583778ae6b49 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:26.966049 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eb7bf459-6b19-4b11-8333-583778ae6b49 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:27.122490 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-eb7bf459-6b19-4b11-8333-583778ae6b49 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:27.131261 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-eb7bf459-6b19-4b11-8333-583778ae6b49 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1522 microversion: 2.1 time: 0.183348 Jun 08 02:07:27.131937 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 131/250] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:26 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:27.733095 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7e4d9318-1c45-476c-9617-ca5c1a836989 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:27.734248 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7e4d9318-1c45-476c-9617-ca5c1a836989 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: aa8e11a7-f659-4bd6-a2ad-3327d14d3706] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:27.746378 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7e4d9318-1c45-476c-9617-ca5c1a836989 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:27.747454 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7e4d9318-1c45-476c-9617-ca5c1a836989 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:27.750112 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7e4d9318-1c45-476c-9617-ca5c1a836989 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:27.750742 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7e4d9318-1c45-476c-9617-ca5c1a836989 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:27.918779 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7e4d9318-1c45-476c-9617-ca5c1a836989 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc19addacb9c412cb008e243c1fc7ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540c921edbf24dbeaf13675b583bb464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:27.921745 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:07:27.928509 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7e4d9318-1c45-476c-9617-ca5c1a836989 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706" status: 200 len: 1283 microversion: 2.1 time: 0.199226 Jun 08 02:07:27.929094 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 120/251] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:27 2022] GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706 => generated 1283 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:28.162275 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e1c43ce5-da3f-4d27-90fd-d693758c05a9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:28.168645 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e1c43ce5-da3f-4d27-90fd-d693758c05a9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:28.184631 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e1c43ce5-da3f-4d27-90fd-d693758c05a9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:28.185230 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e1c43ce5-da3f-4d27-90fd-d693758c05a9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:28.186748 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e1c43ce5-da3f-4d27-90fd-d693758c05a9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:28.187333 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e1c43ce5-da3f-4d27-90fd-d693758c05a9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:28.417688 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e1c43ce5-da3f-4d27-90fd-d693758c05a9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:28.428162 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e1c43ce5-da3f-4d27-90fd-d693758c05a9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1522 microversion: 2.1 time: 0.282186 Jun 08 02:07:28.428928 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 132/252] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:28 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:07:28.947750 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2d53923c-8ce4-4eb5-aac6-52affeb256ae tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:28.948667 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2d53923c-8ce4-4eb5-aac6-52affeb256ae tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: aa8e11a7-f659-4bd6-a2ad-3327d14d3706] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:28.956925 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2d53923c-8ce4-4eb5-aac6-52affeb256ae tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:28.957503 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2d53923c-8ce4-4eb5-aac6-52affeb256ae tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:28.958414 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2d53923c-8ce4-4eb5-aac6-52affeb256ae tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:28.958876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2d53923c-8ce4-4eb5-aac6-52affeb256ae tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:29.112605 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2d53923c-8ce4-4eb5-aac6-52affeb256ae tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc19addacb9c412cb008e243c1fc7ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540c921edbf24dbeaf13675b583bb464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:29.120957 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2d53923c-8ce4-4eb5-aac6-52affeb256ae tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706" status: 200 len: 1313 microversion: 2.1 time: 0.177884 Jun 08 02:07:29.121784 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 121/253] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:28 2022] GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:29.446450 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-65d76071-4d3c-4dc2-9c7b-00d09056c1e2 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:29.447084 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-65d76071-4d3c-4dc2-9c7b-00d09056c1e2 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:29.452997 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-65d76071-4d3c-4dc2-9c7b-00d09056c1e2 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:29.453439 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-65d76071-4d3c-4dc2-9c7b-00d09056c1e2 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:29.454195 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-65d76071-4d3c-4dc2-9c7b-00d09056c1e2 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:29.454628 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-65d76071-4d3c-4dc2-9c7b-00d09056c1e2 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:29.586087 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-65d76071-4d3c-4dc2-9c7b-00d09056c1e2 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:29.593518 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-65d76071-4d3c-4dc2-9c7b-00d09056c1e2 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1522 microversion: 2.1 time: 0.151103 Jun 08 02:07:29.594070 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 133/254] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:29 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:07:30.141140 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1d3fe164-0a03-4f5a-933c-fe9ec2bb7bb9 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:30.141728 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-1d3fe164-0a03-4f5a-933c-fe9ec2bb7bb9 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: aa8e11a7-f659-4bd6-a2ad-3327d14d3706] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:30.148287 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1d3fe164-0a03-4f5a-933c-fe9ec2bb7bb9 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:30.148764 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1d3fe164-0a03-4f5a-933c-fe9ec2bb7bb9 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:30.149557 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1d3fe164-0a03-4f5a-933c-fe9ec2bb7bb9 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:30.149989 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1d3fe164-0a03-4f5a-933c-fe9ec2bb7bb9 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:30.277165 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-1d3fe164-0a03-4f5a-933c-fe9ec2bb7bb9 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc19addacb9c412cb008e243c1fc7ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540c921edbf24dbeaf13675b583bb464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:30.285566 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1d3fe164-0a03-4f5a-933c-fe9ec2bb7bb9 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706" status: 200 len: 1313 microversion: 2.1 time: 0.148075 Jun 08 02:07:30.286208 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 122/255] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:30 2022] GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:30.610189 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ba79c3e9-0676-404a-ac32-fc029263cbd7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:30.610797 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ba79c3e9-0676-404a-ac32-fc029263cbd7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:30.617277 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ba79c3e9-0676-404a-ac32-fc029263cbd7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:30.617721 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ba79c3e9-0676-404a-ac32-fc029263cbd7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:30.618473 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ba79c3e9-0676-404a-ac32-fc029263cbd7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:30.618907 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ba79c3e9-0676-404a-ac32-fc029263cbd7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:30.751062 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ba79c3e9-0676-404a-ac32-fc029263cbd7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:30.758620 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ba79c3e9-0676-404a-ac32-fc029263cbd7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1522 microversion: 2.1 time: 0.152291 Jun 08 02:07:30.759181 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 134/256] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:30 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:31.303441 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a243ef4b-e8f2-4800-8566-bc77d72e6d50 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:31.304072 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a243ef4b-e8f2-4800-8566-bc77d72e6d50 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: aa8e11a7-f659-4bd6-a2ad-3327d14d3706] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:31.310463 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a243ef4b-e8f2-4800-8566-bc77d72e6d50 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:31.310914 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a243ef4b-e8f2-4800-8566-bc77d72e6d50 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:31.311677 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a243ef4b-e8f2-4800-8566-bc77d72e6d50 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:31.312120 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a243ef4b-e8f2-4800-8566-bc77d72e6d50 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:31.526199 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a243ef4b-e8f2-4800-8566-bc77d72e6d50 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc19addacb9c412cb008e243c1fc7ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540c921edbf24dbeaf13675b583bb464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:31.533694 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a243ef4b-e8f2-4800-8566-bc77d72e6d50 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706" status: 200 len: 1313 microversion: 2.1 time: 0.234291 Jun 08 02:07:31.534403 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 123/257] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:31 2022] GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706 => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:31.765175 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-d38b99e4-f6aa-4d29-a150-9dfd725ed91e req-507af7c6-fb74-4bbc-8a51-9b16bc9301ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa8e11a7-f659-4bd6-a2ad-3327d14d3706", "tag": "b5387eb9-1e00-436a-99d1-db7408aa68eb"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:07:31.774792 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-d38b99e4-f6aa-4d29-a150-9dfd725ed91e req-507af7c6-fb74-4bbc-8a51-9b16bc9301ae service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:31.775245 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-d38b99e4-f6aa-4d29-a150-9dfd725ed91e req-507af7c6-fb74-4bbc-8a51-9b16bc9301ae service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:31.775844 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7c621d89-676b-40bc-b211-e794901657ec tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:31.776577 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7c621d89-676b-40bc-b211-e794901657ec tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:31.783362 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7c621d89-676b-40bc-b211-e794901657ec tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:31.784040 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7c621d89-676b-40bc-b211-e794901657ec tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:31.785432 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7c621d89-676b-40bc-b211-e794901657ec tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:31.786030 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7c621d89-676b-40bc-b211-e794901657ec tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:31.809364 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-d38b99e4-f6aa-4d29-a150-9dfd725ed91e req-507af7c6-fb74-4bbc-8a51-9b16bc9301ae service nova] Creating event network-changed:b5387eb9-1e00-436a-99d1-db7408aa68eb for instance aa8e11a7-f659-4bd6-a2ad-3327d14d3706 on hv-cinder-84506 Jun 08 02:07:31.817875 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-d38b99e4-f6aa-4d29-a150-9dfd725ed91e req-507af7c6-fb74-4bbc-8a51-9b16bc9301ae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057480 Jun 08 02:07:31.818517 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 135/258] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:07:31.934110 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7c621d89-676b-40bc-b211-e794901657ec tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:31.942116 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7c621d89-676b-40bc-b211-e794901657ec tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1522 microversion: 2.1 time: 0.170563 Jun 08 02:07:31.942671 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 124/259] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:31 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:07:32.553392 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-5bd13780-ea4e-4173-9d21-2688b08b4f25 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:32.554228 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-5bd13780-ea4e-4173-9d21-2688b08b4f25 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: aa8e11a7-f659-4bd6-a2ad-3327d14d3706] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:32.562164 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5bd13780-ea4e-4173-9d21-2688b08b4f25 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:32.562866 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5bd13780-ea4e-4173-9d21-2688b08b4f25 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:32.564054 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5bd13780-ea4e-4173-9d21-2688b08b4f25 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:32.564606 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5bd13780-ea4e-4173-9d21-2688b08b4f25 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:32.739021 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-5bd13780-ea4e-4173-9d21-2688b08b4f25 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc19addacb9c412cb008e243c1fc7ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540c921edbf24dbeaf13675b583bb464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:32.746401 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-5bd13780-ea4e-4173-9d21-2688b08b4f25 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706" status: 200 len: 1313 microversion: 2.1 time: 0.198390 Jun 08 02:07:32.746959 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 136/260] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:32 2022] GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706 => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:32.882002 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b96e0fff-9301-4936-a606-a942c0509ffc tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:07:32.888477 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b96e0fff-9301-4936-a606-a942c0509ffc tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:32.888916 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b96e0fff-9301-4936-a606-a942c0509ffc tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:32.957441 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b96e0fff-9301-4936-a606-a942c0509ffc tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Going to try to stop instance {{(pid=117938) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 08 02:07:32.960887 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-34543edd-9d11-4055-9ae6-4157ef17ce34 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:32.962013 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-34543edd-9d11-4055-9ae6-4157ef17ce34 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:32.969649 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-34543edd-9d11-4055-9ae6-4157ef17ce34 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:32.970317 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-34543edd-9d11-4055-9ae6-4157ef17ce34 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:32.971088 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-34543edd-9d11-4055-9ae6-4157ef17ce34 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:32.972090 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-34543edd-9d11-4055-9ae6-4157ef17ce34 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:33.012831 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b96e0fff-9301-4936-a606-a942c0509ffc tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "POST /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380/action" status: 202 len: 0 microversion: 2.1 time: 0.134969 Jun 08 02:07:33.013611 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 125/261] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jun 8 02:07:32 2022] POST /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 02:07:33.022287 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-223ba28f-a095-42c4-bfa4-95e551f69717 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:33.022973 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-223ba28f-a095-42c4-bfa4-95e551f69717 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:33.029344 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-223ba28f-a095-42c4-bfa4-95e551f69717 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:33.029788 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-223ba28f-a095-42c4-bfa4-95e551f69717 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:33.030546 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-223ba28f-a095-42c4-bfa4-95e551f69717 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:33.030974 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-223ba28f-a095-42c4-bfa4-95e551f69717 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:33.142350 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-34543edd-9d11-4055-9ae6-4157ef17ce34 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:33.152381 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-34543edd-9d11-4055-9ae6-4157ef17ce34 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1522 microversion: 2.1 time: 0.196669 Jun 08 02:07:33.152990 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 137/262] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:32 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:33.188096 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-223ba28f-a095-42c4-bfa4-95e551f69717 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:33.196087 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-223ba28f-a095-42c4-bfa4-95e551f69717 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1723 microversion: 2.1 time: 0.178466 Jun 08 02:07:33.196676 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 126/263] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:33 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:07:33.764825 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-9b297027-9963-4de5-8f3d-645d4f10963b tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:33.765425 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-9b297027-9963-4de5-8f3d-645d4f10963b tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: aa8e11a7-f659-4bd6-a2ad-3327d14d3706] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:33.771881 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9b297027-9963-4de5-8f3d-645d4f10963b tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:33.772324 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9b297027-9963-4de5-8f3d-645d4f10963b tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:33.773096 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9b297027-9963-4de5-8f3d-645d4f10963b tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:33.773527 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9b297027-9963-4de5-8f3d-645d4f10963b tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:33.910128 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-9b297027-9963-4de5-8f3d-645d4f10963b tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc19addacb9c412cb008e243c1fc7ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540c921edbf24dbeaf13675b583bb464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:33.920062 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-9b297027-9963-4de5-8f3d-645d4f10963b tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706" status: 200 len: 1313 microversion: 2.1 time: 0.160195 Jun 08 02:07:33.920872 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 138/264] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:33 2022] GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:34.170076 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-74b57f82-a2af-41ea-a368-e7c5287062b4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:34.170821 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-74b57f82-a2af-41ea-a368-e7c5287062b4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:34.178533 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-74b57f82-a2af-41ea-a368-e7c5287062b4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:34.178975 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-74b57f82-a2af-41ea-a368-e7c5287062b4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:34.179732 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-74b57f82-a2af-41ea-a368-e7c5287062b4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:34.180191 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-74b57f82-a2af-41ea-a368-e7c5287062b4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:34.213653 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-541594ca-b117-4ffe-9777-032019b144e0 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:34.214263 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-541594ca-b117-4ffe-9777-032019b144e0 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:34.220300 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-541594ca-b117-4ffe-9777-032019b144e0 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:34.220796 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-541594ca-b117-4ffe-9777-032019b144e0 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:34.221558 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-541594ca-b117-4ffe-9777-032019b144e0 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:34.221997 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-541594ca-b117-4ffe-9777-032019b144e0 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:34.371276 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-74b57f82-a2af-41ea-a368-e7c5287062b4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:34.382246 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-74b57f82-a2af-41ea-a368-e7c5287062b4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1522 microversion: 2.1 time: 0.216046 Jun 08 02:07:34.383568 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 127/265] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:34 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:34.416089 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-541594ca-b117-4ffe-9777-032019b144e0 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:34.424675 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-541594ca-b117-4ffe-9777-032019b144e0 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1723 microversion: 2.1 time: 0.214817 Jun 08 02:07:34.425693 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 139/266] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:34 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:07:34.937583 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3f297039-2e4a-47fd-a942-f2d0b9b3950a tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:34.938356 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3f297039-2e4a-47fd-a942-f2d0b9b3950a tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: aa8e11a7-f659-4bd6-a2ad-3327d14d3706] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:34.944678 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3f297039-2e4a-47fd-a942-f2d0b9b3950a tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:34.945118 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3f297039-2e4a-47fd-a942-f2d0b9b3950a tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:34.945865 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3f297039-2e4a-47fd-a942-f2d0b9b3950a tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:34.946289 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3f297039-2e4a-47fd-a942-f2d0b9b3950a tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:35.078027 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3f297039-2e4a-47fd-a942-f2d0b9b3950a tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc19addacb9c412cb008e243c1fc7ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540c921edbf24dbeaf13675b583bb464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:35.085792 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3f297039-2e4a-47fd-a942-f2d0b9b3950a tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706" status: 200 len: 1313 microversion: 2.1 time: 0.152353 Jun 08 02:07:35.086362 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 128/267] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:34 2022] GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:35.399684 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d01da685-bbb3-4304-97a0-5d6e85b1fe59 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:35.400288 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d01da685-bbb3-4304-97a0-5d6e85b1fe59 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:35.406298 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d01da685-bbb3-4304-97a0-5d6e85b1fe59 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:35.406745 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d01da685-bbb3-4304-97a0-5d6e85b1fe59 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:35.407501 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d01da685-bbb3-4304-97a0-5d6e85b1fe59 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:35.407931 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d01da685-bbb3-4304-97a0-5d6e85b1fe59 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:35.443496 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e58fc37f-5b3b-40be-a6e6-2738b579583c tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:35.445197 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e58fc37f-5b3b-40be-a6e6-2738b579583c tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:35.453449 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e58fc37f-5b3b-40be-a6e6-2738b579583c tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:35.454294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e58fc37f-5b3b-40be-a6e6-2738b579583c tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:35.456748 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e58fc37f-5b3b-40be-a6e6-2738b579583c tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:35.457470 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e58fc37f-5b3b-40be-a6e6-2738b579583c tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:35.829397 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d01da685-bbb3-4304-97a0-5d6e85b1fe59 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:35.841624 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d01da685-bbb3-4304-97a0-5d6e85b1fe59 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1522 microversion: 2.1 time: 0.445654 Jun 08 02:07:35.842333 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 140/268] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:35 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1522 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:35.861532 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e58fc37f-5b3b-40be-a6e6-2738b579583c tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:35.872710 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e58fc37f-5b3b-40be-a6e6-2738b579583c tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1723 microversion: 2.1 time: 0.433629 Jun 08 02:07:35.873417 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 129/269] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:35 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1723 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:36.103079 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2633bc60-fd9b-414e-8cd9-2b2f47b70853 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:36.103689 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-2633bc60-fd9b-414e-8cd9-2b2f47b70853 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: aa8e11a7-f659-4bd6-a2ad-3327d14d3706] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:36.110123 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2633bc60-fd9b-414e-8cd9-2b2f47b70853 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:36.110737 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2633bc60-fd9b-414e-8cd9-2b2f47b70853 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:36.111688 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2633bc60-fd9b-414e-8cd9-2b2f47b70853 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:36.112715 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2633bc60-fd9b-414e-8cd9-2b2f47b70853 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:36.375504 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2633bc60-fd9b-414e-8cd9-2b2f47b70853 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc19addacb9c412cb008e243c1fc7ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540c921edbf24dbeaf13675b583bb464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:36.389930 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2633bc60-fd9b-414e-8cd9-2b2f47b70853 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706" status: 200 len: 1313 microversion: 2.1 time: 0.290620 Jun 08 02:07:36.391413 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 141/270] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:36 2022] GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706 => generated 1313 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:07:36.859285 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-08cba432-f41f-4523-afc9-b40b41b7ae8c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:36.860751 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-08cba432-f41f-4523-afc9-b40b41b7ae8c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:36.864137 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:07:36.876589 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-08cba432-f41f-4523-afc9-b40b41b7ae8c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:36.883143 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-08cba432-f41f-4523-afc9-b40b41b7ae8c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:36.884200 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-08cba432-f41f-4523-afc9-b40b41b7ae8c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:36.886299 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-08cba432-f41f-4523-afc9-b40b41b7ae8c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:36.894612 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2bc595f9-2100-4675-9fe2-c04b082d361a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:36.895647 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-2bc595f9-2100-4675-9fe2-c04b082d361a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:36.905891 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=2 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:07:36.908098 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=6 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:07:36.914786 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2bc595f9-2100-4675-9fe2-c04b082d361a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:36.920932 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2bc595f9-2100-4675-9fe2-c04b082d361a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:36.922719 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2bc595f9-2100-4675-9fe2-c04b082d361a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:36.927573 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2bc595f9-2100-4675-9fe2-c04b082d361a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:37.138973 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-08cba432-f41f-4523-afc9-b40b41b7ae8c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:37.149159 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-08cba432-f41f-4523-afc9-b40b41b7ae8c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1522 microversion: 2.1 time: 0.293533 Jun 08 02:07:37.150883 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 130/271] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:36 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:37.179771 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2bc595f9-2100-4675-9fe2-c04b082d361a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:37.188662 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2bc595f9-2100-4675-9fe2-c04b082d361a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1723 microversion: 2.1 time: 0.301383 Jun 08 02:07:37.198439 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 142/272] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:36 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1723 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:37.407652 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2a35c9ab-ffaf-4efd-9e72-228c17b96c14 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:37.408258 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2a35c9ab-ffaf-4efd-9e72-228c17b96c14 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: aa8e11a7-f659-4bd6-a2ad-3327d14d3706] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:37.420240 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2a35c9ab-ffaf-4efd-9e72-228c17b96c14 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:37.420687 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2a35c9ab-ffaf-4efd-9e72-228c17b96c14 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:37.421520 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2a35c9ab-ffaf-4efd-9e72-228c17b96c14 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:37.421887 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2a35c9ab-ffaf-4efd-9e72-228c17b96c14 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:37.826634 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2a35c9ab-ffaf-4efd-9e72-228c17b96c14 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc19addacb9c412cb008e243c1fc7ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540c921edbf24dbeaf13675b583bb464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:37.835342 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2a35c9ab-ffaf-4efd-9e72-228c17b96c14 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706" status: 200 len: 1313 microversion: 2.1 time: 0.431299 Jun 08 02:07:37.847112 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 131/273] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:37 2022] GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706 => generated 1313 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:38.170311 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c56d9601-ed70-4d7a-b461-ba144795e2ff tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:38.171526 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c56d9601-ed70-4d7a-b461-ba144795e2ff tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:38.181062 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c56d9601-ed70-4d7a-b461-ba144795e2ff tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:38.183097 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c56d9601-ed70-4d7a-b461-ba144795e2ff tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:38.185367 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c56d9601-ed70-4d7a-b461-ba144795e2ff tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:38.185804 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c56d9601-ed70-4d7a-b461-ba144795e2ff tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:38.207664 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-28de83cb-b680-4008-8c98-a2653ffd6a44 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:38.208676 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-28de83cb-b680-4008-8c98-a2653ffd6a44 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:38.216354 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-28de83cb-b680-4008-8c98-a2653ffd6a44 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:38.217116 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-28de83cb-b680-4008-8c98-a2653ffd6a44 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:38.218211 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-28de83cb-b680-4008-8c98-a2653ffd6a44 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:38.218667 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-28de83cb-b680-4008-8c98-a2653ffd6a44 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:38.579739 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c56d9601-ed70-4d7a-b461-ba144795e2ff tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:38.588367 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c56d9601-ed70-4d7a-b461-ba144795e2ff tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1522 microversion: 2.1 time: 0.422525 Jun 08 02:07:38.588958 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 143/274] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:38 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1522 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:38.625905 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-28de83cb-b680-4008-8c98-a2653ffd6a44 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:38.641750 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-28de83cb-b680-4008-8c98-a2653ffd6a44 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1723 microversion: 2.1 time: 0.440047 Jun 08 02:07:38.643509 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 132/275] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:38 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1723 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:38.852563 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-489c78f1-ddec-4db0-be1e-4b97deabe256 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:38.853186 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-489c78f1-ddec-4db0-be1e-4b97deabe256 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: aa8e11a7-f659-4bd6-a2ad-3327d14d3706] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:38.862633 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-489c78f1-ddec-4db0-be1e-4b97deabe256 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:38.863077 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-489c78f1-ddec-4db0-be1e-4b97deabe256 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:38.866693 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-489c78f1-ddec-4db0-be1e-4b97deabe256 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:38.868089 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-489c78f1-ddec-4db0-be1e-4b97deabe256 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:39.265175 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-489c78f1-ddec-4db0-be1e-4b97deabe256 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc19addacb9c412cb008e243c1fc7ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540c921edbf24dbeaf13675b583bb464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:39.277135 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-489c78f1-ddec-4db0-be1e-4b97deabe256 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706" status: 200 len: 1313 microversion: 2.1 time: 0.428980 Jun 08 02:07:39.289893 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 144/276] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:38 2022] GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706 => generated 1313 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:39.605287 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8c543a7e-4db2-4d80-9de3-97a94ffc5081 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:39.605942 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8c543a7e-4db2-4d80-9de3-97a94ffc5081 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:39.614838 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8c543a7e-4db2-4d80-9de3-97a94ffc5081 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:39.615293 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8c543a7e-4db2-4d80-9de3-97a94ffc5081 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:39.616072 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8c543a7e-4db2-4d80-9de3-97a94ffc5081 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:39.616537 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8c543a7e-4db2-4d80-9de3-97a94ffc5081 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:39.663083 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-adcd6a6d-a0b4-4598-a8cb-4d6b07e294c9 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:39.664032 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-adcd6a6d-a0b4-4598-a8cb-4d6b07e294c9 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:39.678331 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-adcd6a6d-a0b4-4598-a8cb-4d6b07e294c9 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:39.679080 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-adcd6a6d-a0b4-4598-a8cb-4d6b07e294c9 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:39.679884 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-adcd6a6d-a0b4-4598-a8cb-4d6b07e294c9 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:39.680322 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-adcd6a6d-a0b4-4598-a8cb-4d6b07e294c9 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:39.721643 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=100 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:07:39.980219 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8c543a7e-4db2-4d80-9de3-97a94ffc5081 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:39.996959 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8c543a7e-4db2-4d80-9de3-97a94ffc5081 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1522 microversion: 2.1 time: 0.387698 Jun 08 02:07:39.998606 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 133/277] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:39 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1522 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:40.074571 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-adcd6a6d-a0b4-4598-a8cb-4d6b07e294c9 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:40.097061 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-adcd6a6d-a0b4-4598-a8cb-4d6b07e294c9 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1723 microversion: 2.1 time: 0.432291 Jun 08 02:07:40.114588 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 145/278] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:39 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1723 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:40.296495 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-41d0537a-2669-4d93-ad92-f5c2b3d71844 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:40.297336 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-41d0537a-2669-4d93-ad92-f5c2b3d71844 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: aa8e11a7-f659-4bd6-a2ad-3327d14d3706] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:40.308427 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-41d0537a-2669-4d93-ad92-f5c2b3d71844 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:40.308893 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-41d0537a-2669-4d93-ad92-f5c2b3d71844 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:40.312299 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-41d0537a-2669-4d93-ad92-f5c2b3d71844 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:40.312996 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-41d0537a-2669-4d93-ad92-f5c2b3d71844 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:40.544891 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-41d0537a-2669-4d93-ad92-f5c2b3d71844 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc19addacb9c412cb008e243c1fc7ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540c921edbf24dbeaf13675b583bb464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:40.552895 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-41d0537a-2669-4d93-ad92-f5c2b3d71844 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706" status: 200 len: 1313 microversion: 2.1 time: 0.260169 Jun 08 02:07:40.556116 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 134/279] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:40 2022] GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706 => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:40.587124 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-3f1f1827-fb1a-4d6f-a092-47f0eaf1015f req-79659f3c-aa55-46c8-a36e-3a8c47f589cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa8e11a7-f659-4bd6-a2ad-3327d14d3706", "name": "network-vif-plugged", "status": "completed", "tag": "b5387eb9-1e00-436a-99d1-db7408aa68eb"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:07:40.613684 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-3f1f1827-fb1a-4d6f-a092-47f0eaf1015f req-79659f3c-aa55-46c8-a36e-3a8c47f589cf service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:40.614132 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-3f1f1827-fb1a-4d6f-a092-47f0eaf1015f req-79659f3c-aa55-46c8-a36e-3a8c47f589cf service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:40.649668 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-3f1f1827-fb1a-4d6f-a092-47f0eaf1015f req-79659f3c-aa55-46c8-a36e-3a8c47f589cf service nova] Creating event network-vif-plugged:b5387eb9-1e00-436a-99d1-db7408aa68eb for instance aa8e11a7-f659-4bd6-a2ad-3327d14d3706 on hv-cinder-84506 Jun 08 02:07:40.663844 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-3f1f1827-fb1a-4d6f-a092-47f0eaf1015f req-79659f3c-aa55-46c8-a36e-3a8c47f589cf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080252 Jun 08 02:07:40.667010 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 146/280] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:07:41.014980 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-37686cba-bd96-44ed-9652-efec7d3f23bf tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:41.016188 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-37686cba-bd96-44ed-9652-efec7d3f23bf tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:41.022719 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-37686cba-bd96-44ed-9652-efec7d3f23bf tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:41.023173 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-37686cba-bd96-44ed-9652-efec7d3f23bf tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:41.023939 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-37686cba-bd96-44ed-9652-efec7d3f23bf tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:41.024704 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-37686cba-bd96-44ed-9652-efec7d3f23bf tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:41.123509 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-520a4042-1675-44fc-8f62-cf0249ff5711 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:41.124203 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-520a4042-1675-44fc-8f62-cf0249ff5711 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:41.130873 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-520a4042-1675-44fc-8f62-cf0249ff5711 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:41.131316 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-520a4042-1675-44fc-8f62-cf0249ff5711 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:41.132263 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-520a4042-1675-44fc-8f62-cf0249ff5711 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:41.132800 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-520a4042-1675-44fc-8f62-cf0249ff5711 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:41.197047 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-37686cba-bd96-44ed-9652-efec7d3f23bf tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:41.218870 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-37686cba-bd96-44ed-9652-efec7d3f23bf tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1502 microversion: 2.1 time: 0.207393 Jun 08 02:07:41.219984 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 135/281] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:41 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1502 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:41.237864 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4af093fb-091d-45b1-ba68-881f1528f810 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad62af11-e380-4ea2-9866-c3d566c6da51"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:07:41.239388 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4af093fb-091d-45b1-ba68-881f1528f810 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:41.251807 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4af093fb-091d-45b1-ba68-881f1528f810 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:41.254138 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4af093fb-091d-45b1-ba68-881f1528f810 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:41.256342 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4af093fb-091d-45b1-ba68-881f1528f810 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:41.257228 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4af093fb-091d-45b1-ba68-881f1528f810 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:41.289325 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:07:41.304440 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-4af093fb-091d-45b1-ba68-881f1528f810 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] HTTP exception thrown: Cannot 'attach_volume' instance f4fe47a1-fdef-478e-94c7-42b5945a57ae while it is in vm_state rescued Jun 08 02:07:41.307838 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4af093fb-091d-45b1-ba68-881f1528f810 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Request method failure captured: Jun 08 02:07:41.307838 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: request: POST /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae/os-volume_attachments HTTP/1.1 Jun 08 02:07:41.307838 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept: application/json Jun 08 02:07:41.307838 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jun 08 02:07:41.307838 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Connection: close Jun 08 02:07:41.307838 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Length: 74 Jun 08 02:07:41.307838 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jun 08 02:07:41.307838 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Host: 10.222.0.20 Jun 08 02:07:41.307838 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jun 08 02:07:41.307838 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jun 08 02:07:41.307838 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABioAPv8gMotrJlZTFwglagYqckJEX1fLvg2vCOIJVfZx23pLMKwu0kMosHU2TJEE42L3PHJCygQBsaqUei7q2GmAE1OvpdyyA2K6f4U-qDG0gFChJCyiiFe6KgYhekG7cdzFKfmztAXfzdnIapCZ5hWCdvq58rcVhDFHy9z0kDGo3H5gg Jun 08 02:07:41.307838 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jun 08 02:07:41.307838 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jun 08 02:07:41.307838 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jun 08 02:07:41.307838 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jun 08 02:07:41.307838 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jun 08 02:07:41.307838 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jun 08 02:07:41.307838 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Id: d40d753f66ec4ed2808aa65b825e66f8 Jun 08 02:07:41.307838 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-237519543 Jun 08 02:07:41.307838 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jun 08 02:07:41.307838 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jun 08 02:07:41.309376 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d40d753f66ec4ed2808aa65b825e66f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d40d753f66ec4ed2808aa65b825e66f8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d40d753f66ec4ed2808aa65b825e66f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d40d753f66ec4ed2808aa65b825e66f8"}]}] Jun 08 02:07:41.309376 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-ServerRescueNegativeTestJSON-237519543 Jun 08 02:07:41.309376 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Id: d40d753f66ec4ed2808aa65b825e66f8 Jun 08 02:07:41.309376 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-237519543 Jun 08 02:07:41.309376 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User: tempest-ServerRescueNegativeTestJSON-237519543-project Jun 08 02:07:41.309376 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jun 08 02:07:41.309376 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jun 08 02:07:41.309376 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Id: 9e13bd970d2e4d67b62452ae0d6cae56 Jun 08 02:07:41.309376 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-ServerRescueNegativeTestJSON-237519543-project Jun 08 02:07:41.309376 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Jun 08 02:07:41.309376 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: {"volumeAttachment": {"volumeId": "ad62af11-e380-4ea2-9866-c3d566c6da51"}} Jun 08 02:07:41.309376 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: method: > Jun 08 02:07:41.310644 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: exception: Cannot 'attach_volume' instance f4fe47a1-fdef-478e-94c7-42b5945a57ae while it is in vm_state rescued Jun 08 02:07:41.310644 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: action_args: {'server_id': 'f4fe47a1-fdef-478e-94c7-42b5945a57ae', 'body': {'volumeAttachment': {'volumeId': 'ad62af11-e380-4ea2-9866-c3d566c6da51'}}} Jun 08 02:07:41.310644 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:07:41.310644 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:07:41.310644 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 08 02:07:41.310644 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 08 02:07:41.310644 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 08 02:07:41.310644 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 08 02:07:41.310644 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 08 02:07:41.310644 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 08 02:07:41.310644 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f4fe47a1-fdef-478e-94c7-42b5945a57ae in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 08 02:07:41.310644 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:07:41.310644 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:07:41.310644 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:07:41.310644 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:07:41.310644 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:07:41.310644 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:07:41.310644 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:07:41.310644 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:07:41.311967 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:07:41.311967 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:07:41.311967 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 08 02:07:41.311967 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 08 02:07:41.311967 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 08 02:07:41.311967 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 08 02:07:41.311967 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 08 02:07:41.311967 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 08 02:07:41.311967 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 08 02:07:41.311967 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 08 02:07:41.311967 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 08 02:07:41.311967 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 08 02:07:41.311967 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f4fe47a1-fdef-478e-94c7-42b5945a57ae while it is in vm_state rescued Jun 08 02:07:41.311967 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:07:41.311967 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:07:41.311967 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:07:41.311967 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:07:41.311967 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:07:41.311967 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:07:41.313325 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:07:41.313325 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:07:41.313325 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f4fe47a1-fdef-478e-94c7-42b5945a57ae while it is in vm_state rescued Jun 08 02:07:41.313325 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:07:41.316972 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4af093fb-091d-45b1-ba68-881f1528f810 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Returning 409 to user: Cannot 'attach_volume' instance f4fe47a1-fdef-478e-94c7-42b5945a57ae while it is in vm_state rescued {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:07:41.318523 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4af093fb-091d-45b1-ba68-881f1528f810 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "POST /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.084691 Jun 08 02:07:41.323695 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 136/282] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jun 8 02:07:41 2022] POST /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae/os-volume_attachments => generated 152 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 08 02:07:41.330955 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-fef4e6b0-dec7-4459-80a4-a99154e12a06 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:07:41.335011 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-520a4042-1675-44fc-8f62-cf0249ff5711 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:41.339415 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-fef4e6b0-dec7-4459-80a4-a99154e12a06 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:41.345716 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-520a4042-1675-44fc-8f62-cf0249ff5711 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1723 microversion: 2.1 time: 0.227125 Jun 08 02:07:41.348480 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 147/283] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:41 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:07:41.352867 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fef4e6b0-dec7-4459-80a4-a99154e12a06 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:41.353536 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fef4e6b0-dec7-4459-80a4-a99154e12a06 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:41.354592 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fef4e6b0-dec7-4459-80a4-a99154e12a06 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:41.355297 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fef4e6b0-dec7-4459-80a4-a99154e12a06 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:41.462985 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-fef4e6b0-dec7-4459-80a4-a99154e12a06 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "POST /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae/action" status: 202 len: 0 microversion: 2.1 time: 0.137735 Jun 08 02:07:41.465404 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 137/284] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jun 8 02:07:41 2022] POST /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 02:07:41.474392 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-cc4e1ef2-31fa-4de3-b71e-fe68d7c31c65 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:41.475630 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-cc4e1ef2-31fa-4de3-b71e-fe68d7c31c65 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:41.483012 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cc4e1ef2-31fa-4de3-b71e-fe68d7c31c65 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:41.483700 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cc4e1ef2-31fa-4de3-b71e-fe68d7c31c65 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:41.485038 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cc4e1ef2-31fa-4de3-b71e-fe68d7c31c65 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:41.485689 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cc4e1ef2-31fa-4de3-b71e-fe68d7c31c65 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:41.576346 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-91ba0d12-b31d-4ef9-91ed-55ab13c3e52e tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:41.577094 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-91ba0d12-b31d-4ef9-91ed-55ab13c3e52e tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: aa8e11a7-f659-4bd6-a2ad-3327d14d3706] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:41.589447 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-91ba0d12-b31d-4ef9-91ed-55ab13c3e52e tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:41.589988 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-91ba0d12-b31d-4ef9-91ed-55ab13c3e52e tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:41.591465 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-91ba0d12-b31d-4ef9-91ed-55ab13c3e52e tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:41.594264 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-91ba0d12-b31d-4ef9-91ed-55ab13c3e52e tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:41.789766 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-cc4e1ef2-31fa-4de3-b71e-fe68d7c31c65 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:41.822813 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-cc4e1ef2-31fa-4de3-b71e-fe68d7c31c65 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1510 microversion: 2.1 time: 0.350240 Jun 08 02:07:41.841430 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 148/285] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:41 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1510 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:41.905950 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-91ba0d12-b31d-4ef9-91ed-55ab13c3e52e tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc19addacb9c412cb008e243c1fc7ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540c921edbf24dbeaf13675b583bb464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:41.915239 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-91ba0d12-b31d-4ef9-91ed-55ab13c3e52e tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706" status: 200 len: 1313 microversion: 2.1 time: 0.344151 Jun 08 02:07:41.918445 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 138/286] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:41 2022] GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706 => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:42.372810 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-1ec21092-5d07-4a39-8edc-f59d6c54e75a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:42.373462 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-1ec21092-5d07-4a39-8edc-f59d6c54e75a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:42.394161 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1ec21092-5d07-4a39-8edc-f59d6c54e75a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:42.394617 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1ec21092-5d07-4a39-8edc-f59d6c54e75a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:42.395540 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1ec21092-5d07-4a39-8edc-f59d6c54e75a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:42.396009 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1ec21092-5d07-4a39-8edc-f59d6c54e75a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:42.682433 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1ec21092-5d07-4a39-8edc-f59d6c54e75a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:42.694373 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-1ec21092-5d07-4a39-8edc-f59d6c54e75a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1723 microversion: 2.1 time: 0.332880 Jun 08 02:07:42.697380 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 149/287] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:42 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1723 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:42.858543 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2566eb4a-af2c-4aa6-910c-5898d293c523 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:42.862227 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2566eb4a-af2c-4aa6-910c-5898d293c523 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:42.876115 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2566eb4a-af2c-4aa6-910c-5898d293c523 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:42.879820 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2566eb4a-af2c-4aa6-910c-5898d293c523 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:42.881031 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2566eb4a-af2c-4aa6-910c-5898d293c523 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:42.881692 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2566eb4a-af2c-4aa6-910c-5898d293c523 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:42.933512 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e9917c56-9db3-4726-b091-5d88dbb04d77 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:42.935012 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e9917c56-9db3-4726-b091-5d88dbb04d77 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: aa8e11a7-f659-4bd6-a2ad-3327d14d3706] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:42.951394 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e9917c56-9db3-4726-b091-5d88dbb04d77 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:42.952415 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e9917c56-9db3-4726-b091-5d88dbb04d77 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:42.954770 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e9917c56-9db3-4726-b091-5d88dbb04d77 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:42.964606 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e9917c56-9db3-4726-b091-5d88dbb04d77 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:43.224896 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2566eb4a-af2c-4aa6-910c-5898d293c523 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:43.236917 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2566eb4a-af2c-4aa6-910c-5898d293c523 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1510 microversion: 2.1 time: 0.382005 Jun 08 02:07:43.246429 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 139/288] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:42 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1510 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:43.418373 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e9917c56-9db3-4726-b091-5d88dbb04d77 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc19addacb9c412cb008e243c1fc7ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540c921edbf24dbeaf13675b583bb464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:43.427126 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e9917c56-9db3-4726-b091-5d88dbb04d77 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706" status: 200 len: 1497 microversion: 2.1 time: 0.497598 Jun 08 02:07:43.447230 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 150/289] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:42 2022] GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706 => generated 1497 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:43.714474 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cfb99eac-3d94-4fb9-a507-b8ccab386871 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:43.715087 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-cfb99eac-3d94-4fb9-a507-b8ccab386871 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:43.726069 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cfb99eac-3d94-4fb9-a507-b8ccab386871 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:43.726519 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cfb99eac-3d94-4fb9-a507-b8ccab386871 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:43.727298 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cfb99eac-3d94-4fb9-a507-b8ccab386871 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:43.727734 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cfb99eac-3d94-4fb9-a507-b8ccab386871 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:43.999571 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-cfb99eac-3d94-4fb9-a507-b8ccab386871 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:44.020659 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-cfb99eac-3d94-4fb9-a507-b8ccab386871 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1723 microversion: 2.1 time: 0.309820 Jun 08 02:07:44.030763 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 140/290] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:43 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1723 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:44.241597 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-53aa1d5f-a71c-4a6b-9e18-322f3123ce00 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:44.242146 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-53aa1d5f-a71c-4a6b-9e18-322f3123ce00 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: aa8e11a7-f659-4bd6-a2ad-3327d14d3706] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:44.255943 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-408f1906-8833-4379-a593-e967e2b3eba7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:44.257023 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-408f1906-8833-4379-a593-e967e2b3eba7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:44.263593 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-53aa1d5f-a71c-4a6b-9e18-322f3123ce00 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:44.267079 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-408f1906-8833-4379-a593-e967e2b3eba7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:44.267536 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-408f1906-8833-4379-a593-e967e2b3eba7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:44.268902 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-408f1906-8833-4379-a593-e967e2b3eba7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:44.269341 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-408f1906-8833-4379-a593-e967e2b3eba7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:44.270058 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-53aa1d5f-a71c-4a6b-9e18-322f3123ce00 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:44.271083 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-53aa1d5f-a71c-4a6b-9e18-322f3123ce00 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:44.271726 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-53aa1d5f-a71c-4a6b-9e18-322f3123ce00 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:44.304866 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-53aa1d5f-a71c-4a6b-9e18-322f3123ce00 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: aa8e11a7-f659-4bd6-a2ad-3327d14d3706] Going to try to terminate instance {{(pid=117939) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 02:07:44.422869 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-53aa1d5f-a71c-4a6b-9e18-322f3123ce00 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "DELETE /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706" status: 204 len: 0 microversion: 2.1 time: 0.184723 Jun 08 02:07:44.424782 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 151/291] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jun 8 02:07:44 2022] DELETE /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 08 02:07:44.434109 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e019ed1f-81f4-4319-86c2-ef54bd00e7ca tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:44.435326 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e019ed1f-81f4-4319-86c2-ef54bd00e7ca tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: aa8e11a7-f659-4bd6-a2ad-3327d14d3706] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:44.453585 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e019ed1f-81f4-4319-86c2-ef54bd00e7ca tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:44.454610 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e019ed1f-81f4-4319-86c2-ef54bd00e7ca tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:44.456651 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e019ed1f-81f4-4319-86c2-ef54bd00e7ca tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:44.457445 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e019ed1f-81f4-4319-86c2-ef54bd00e7ca tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:44.558982 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-408f1906-8833-4379-a593-e967e2b3eba7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:44.569403 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-408f1906-8833-4379-a593-e967e2b3eba7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1510 microversion: 2.1 time: 0.319422 Jun 08 02:07:44.576740 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 141/292] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:44 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1510 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:44.645301 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e019ed1f-81f4-4319-86c2-ef54bd00e7ca tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc19addacb9c412cb008e243c1fc7ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540c921edbf24dbeaf13675b583bb464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:44.653835 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e019ed1f-81f4-4319-86c2-ef54bd00e7ca tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706" status: 200 len: 1503 microversion: 2.1 time: 0.224623 Jun 08 02:07:44.654408 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 152/293] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:44 2022] GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706 => generated 1503 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:44.856005 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-353465ca-d13c-483c-a2a5-f9fbdc532693 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-872989903", "imageRef": "e648e482-e374-429d-8152-a4a63797f314", "flavorRef": "452", "networks": [{"uuid": "0805388c-c568-4da3-817b-3be9b163906b"}]}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:07:44.945673 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.network.neutron [None req-353465ca-d13c-483c-a2a5-f9fbdc532693 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] validate_networks() for [('0805388c-c568-4da3-817b-3be9b163906b', None, None, None, None, None)] {{(pid=117938) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 02:07:45.039412 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e0f6ba4d-b7dd-4a8a-8303-fbc75b8f7e9b tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:45.040671 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e0f6ba4d-b7dd-4a8a-8303-fbc75b8f7e9b tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:45.062542 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e0f6ba4d-b7dd-4a8a-8303-fbc75b8f7e9b tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:45.062997 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e0f6ba4d-b7dd-4a8a-8303-fbc75b8f7e9b tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:45.063781 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e0f6ba4d-b7dd-4a8a-8303-fbc75b8f7e9b tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:45.064215 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e0f6ba4d-b7dd-4a8a-8303-fbc75b8f7e9b tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:45.715832 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e0f6ba4d-b7dd-4a8a-8303-fbc75b8f7e9b tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:45.727615 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e0f6ba4d-b7dd-4a8a-8303-fbc75b8f7e9b tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1723 microversion: 2.1 time: 0.691999 Jun 08 02:07:45.744607 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 153/294] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:45 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1723 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:45.750187 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-3c60c660-e983-4f39-b579-f4434a7d2e81 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:45.755654 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-3c60c660-e983-4f39-b579-f4434a7d2e81 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:45.764443 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3c60c660-e983-4f39-b579-f4434a7d2e81 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:45.765072 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3c60c660-e983-4f39-b579-f4434a7d2e81 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:45.765935 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3c60c660-e983-4f39-b579-f4434a7d2e81 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:45.766583 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3c60c660-e983-4f39-b579-f4434a7d2e81 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:46.105393 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-3c60c660-e983-4f39-b579-f4434a7d2e81 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:46.121062 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-3c60c660-e983-4f39-b579-f4434a7d2e81 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1510 microversion: 2.1 time: 0.374964 Jun 08 02:07:46.121672 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 154/295] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:45 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1510 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:46.126564 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d384489d-86b5-4b2f-b71c-c42777c25fc0 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:46.127748 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d384489d-86b5-4b2f-b71c-c42777c25fc0 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: aa8e11a7-f659-4bd6-a2ad-3327d14d3706] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:46.141099 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d384489d-86b5-4b2f-b71c-c42777c25fc0 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:46.141553 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d384489d-86b5-4b2f-b71c-c42777c25fc0 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:46.145431 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d384489d-86b5-4b2f-b71c-c42777c25fc0 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:46.147055 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d384489d-86b5-4b2f-b71c-c42777c25fc0 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:46.429116 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-353465ca-d13c-483c-a2a5-f9fbdc532693 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Flavor limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 02:07:46.429669 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-353465ca-d13c-483c-a2a5-f9fbdc532693 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Image limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 02:07:46.430512 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-353465ca-d13c-483c-a2a5-f9fbdc532693 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Flavor pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 02:07:46.431049 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-353465ca-d13c-483c-a2a5-f9fbdc532693 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Image pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 02:07:46.432856 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-353465ca-d13c-483c-a2a5-f9fbdc532693 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 02:07:46.451307 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-353465ca-d13c-483c-a2a5-f9fbdc532693 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:46.452029 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-353465ca-d13c-483c-a2a5-f9fbdc532693 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:46.458177 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-353465ca-d13c-483c-a2a5-f9fbdc532693 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:46.461970 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-353465ca-d13c-483c-a2a5-f9fbdc532693 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:46.468113 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d384489d-86b5-4b2f-b71c-c42777c25fc0 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc19addacb9c412cb008e243c1fc7ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540c921edbf24dbeaf13675b583bb464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:46.479663 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d384489d-86b5-4b2f-b71c-c42777c25fc0 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706" status: 200 len: 1503 microversion: 2.1 time: 0.356812 Jun 08 02:07:46.482324 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 155/296] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:46 2022] GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706 => generated 1503 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:46.499355 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-353465ca-d13c-483c-a2a5-f9fbdc532693 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Getting quotas for project 68cd7ed883a04e91b36482a8950b12d1. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 02:07:46.505063 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-353465ca-d13c-483c-a2a5-f9fbdc532693 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Getting quotas for user f9556a3adc6b40ee93c498fb98cd77ea and project 68cd7ed883a04e91b36482a8950b12d1. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 02:07:46.518130 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-353465ca-d13c-483c-a2a5-f9fbdc532693 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Going to run 1 instances... {{(pid=117938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 02:07:46.525035 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-353465ca-d13c-483c-a2a5-f9fbdc532693 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: dc44145c-7cae-45fa-b339-fd2b3c42e275] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e648e482-e374-429d-8152-a4a63797f314',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 02:07:46.614596 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-353465ca-d13c-483c-a2a5-f9fbdc532693 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.762271 Jun 08 02:07:46.615254 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 142/297] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jun 8 02:07:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 08 02:07:46.627659 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ca1557ad-8e64-46a6-927d-3247154e996e tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:46.628828 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ca1557ad-8e64-46a6-927d-3247154e996e tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: dc44145c-7cae-45fa-b339-fd2b3c42e275] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:46.748637 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-fbe0be01-d64d-4f4a-b827-4a5e251e103b tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:46.749790 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-fbe0be01-d64d-4f4a-b827-4a5e251e103b tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:46.774269 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fbe0be01-d64d-4f4a-b827-4a5e251e103b tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:46.777395 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fbe0be01-d64d-4f4a-b827-4a5e251e103b tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:46.782452 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fbe0be01-d64d-4f4a-b827-4a5e251e103b tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:46.786908 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fbe0be01-d64d-4f4a-b827-4a5e251e103b tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:46.807956 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ca1557ad-8e64-46a6-927d-3247154e996e tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:46.820174 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ca1557ad-8e64-46a6-927d-3247154e996e tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275" status: 200 len: 1218 microversion: 2.1 time: 0.197072 Jun 08 02:07:46.823822 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 156/298] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:46 2022] GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275 => generated 1218 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:47.140558 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0dd4cab4-5d46-44f4-a838-ed30abf65197 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:47.142083 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-0dd4cab4-5d46-44f4-a838-ed30abf65197 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:47.164298 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0dd4cab4-5d46-44f4-a838-ed30abf65197 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:47.166849 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0dd4cab4-5d46-44f4-a838-ed30abf65197 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:47.167672 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0dd4cab4-5d46-44f4-a838-ed30abf65197 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:47.168122 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0dd4cab4-5d46-44f4-a838-ed30abf65197 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:47.313783 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fbe0be01-d64d-4f4a-b827-4a5e251e103b tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:47.331707 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-fbe0be01-d64d-4f4a-b827-4a5e251e103b tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1723 microversion: 2.1 time: 0.583633 Jun 08 02:07:47.333906 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 143/299] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:46 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1723 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:07:47.503693 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-00035227-0e0f-4640-a5e1-f961cd94173c tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:47.505108 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-00035227-0e0f-4640-a5e1-f961cd94173c tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: aa8e11a7-f659-4bd6-a2ad-3327d14d3706] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:47.511864 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-00035227-0e0f-4640-a5e1-f961cd94173c tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:47.512664 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-00035227-0e0f-4640-a5e1-f961cd94173c tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:47.513637 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-00035227-0e0f-4640-a5e1-f961cd94173c tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:47.514283 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-00035227-0e0f-4640-a5e1-f961cd94173c tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:47.697867 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-0dd4cab4-5d46-44f4-a838-ed30abf65197 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:47.706175 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-0dd4cab4-5d46-44f4-a838-ed30abf65197 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1516 microversion: 2.1 time: 0.571583 Jun 08 02:07:47.706758 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 157/300] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:47 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1516 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:47.845017 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-baa28703-8af0-4705-bd4a-7c0b0db2877f tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:47.846365 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-baa28703-8af0-4705-bd4a-7c0b0db2877f tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: dc44145c-7cae-45fa-b339-fd2b3c42e275] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:47.856976 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-baa28703-8af0-4705-bd4a-7c0b0db2877f tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:47.859448 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-baa28703-8af0-4705-bd4a-7c0b0db2877f tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:47.860243 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-baa28703-8af0-4705-bd4a-7c0b0db2877f tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:47.860720 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-baa28703-8af0-4705-bd4a-7c0b0db2877f tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:48.039612 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-00035227-0e0f-4640-a5e1-f961cd94173c tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc19addacb9c412cb008e243c1fc7ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540c921edbf24dbeaf13675b583bb464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:48.054139 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-00035227-0e0f-4640-a5e1-f961cd94173c tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706" status: 200 len: 1503 microversion: 2.1 time: 0.555524 Jun 08 02:07:48.054737 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 144/301] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:47 2022] GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706 => generated 1503 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:48.068149 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-baa28703-8af0-4705-bd4a-7c0b0db2877f tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:48.084203 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-baa28703-8af0-4705-bd4a-7c0b0db2877f tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275" status: 200 len: 1270 microversion: 2.1 time: 0.244143 Jun 08 02:07:48.085351 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 158/302] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:47 2022] GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275 => generated 1270 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:07:48.351352 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8fb57e25-b655-42f8-b72e-a4ff6075ea84 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:48.352211 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8fb57e25-b655-42f8-b72e-a4ff6075ea84 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:48.358772 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8fb57e25-b655-42f8-b72e-a4ff6075ea84 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:48.359307 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8fb57e25-b655-42f8-b72e-a4ff6075ea84 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:48.360132 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8fb57e25-b655-42f8-b72e-a4ff6075ea84 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:48.360667 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8fb57e25-b655-42f8-b72e-a4ff6075ea84 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:49.046999 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8fb57e25-b655-42f8-b72e-a4ff6075ea84 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:49.057159 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8fb57e25-b655-42f8-b72e-a4ff6075ea84 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1723 microversion: 2.1 time: 0.710614 Jun 08 02:07:49.057824 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 145/303] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:48 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1723 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:49.073519 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-fc5f2eb9-9153-46d5-a502-e42a20e004a8 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:49.075264 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-fc5f2eb9-9153-46d5-a502-e42a20e004a8 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: aa8e11a7-f659-4bd6-a2ad-3327d14d3706] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:49.083063 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fc5f2eb9-9153-46d5-a502-e42a20e004a8 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:49.084525 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fc5f2eb9-9153-46d5-a502-e42a20e004a8 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:49.085857 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fc5f2eb9-9153-46d5-a502-e42a20e004a8 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:49.086453 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fc5f2eb9-9153-46d5-a502-e42a20e004a8 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:49.106351 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9804f6ce-3664-4bb6-9a32-ae228741f341 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:49.108342 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9804f6ce-3664-4bb6-9a32-ae228741f341 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: dc44145c-7cae-45fa-b339-fd2b3c42e275] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:49.132129 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9804f6ce-3664-4bb6-9a32-ae228741f341 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:49.132615 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9804f6ce-3664-4bb6-9a32-ae228741f341 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:49.133394 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9804f6ce-3664-4bb6-9a32-ae228741f341 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:49.133825 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9804f6ce-3664-4bb6-9a32-ae228741f341 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:49.259750 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-fc5f2eb9-9153-46d5-a502-e42a20e004a8 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc19addacb9c412cb008e243c1fc7ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540c921edbf24dbeaf13675b583bb464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:49.271308 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-fc5f2eb9-9153-46d5-a502-e42a20e004a8 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706" status: 200 len: 1461 microversion: 2.1 time: 0.203547 Jun 08 02:07:49.271883 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 159/304] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:49 2022] GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706 => generated 1461 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:49.277303 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2d319c12-427d-477e-80be-21da412fd5c8 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Action: 'create', calling method: .version_select at 0x7f83700cdee0>, body: {"keypair": {"name": "tempest-keypair-883393138", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPf11zMSbXu2mnbwXatJ5ziFP3A/5TnDvJ+XsJ74k+83UYD+0riW2KbUKMUdPKm/a8CYVQlZ5JuXSupKdFTjsNeN2BKypA/Pj+JMzjKFNxIW1fZzVlLF7TOMYM8PCXpUg=="}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:07:49.298097 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9804f6ce-3664-4bb6-9a32-ae228741f341 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:49.304647 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-2d319c12-427d-477e-80be-21da412fd5c8 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Getting quotas for project d40d753f66ec4ed2808aa65b825e66f8. Resources: {'key_pairs'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 02:07:49.307351 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9804f6ce-3664-4bb6-9a32-ae228741f341 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275" status: 200 len: 1276 microversion: 2.1 time: 0.205608 Jun 08 02:07:49.307933 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 146/305] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:49 2022] GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275 => generated 1276 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:49.313601 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-2d319c12-427d-477e-80be-21da412fd5c8 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Getting quotas for user 9e13bd970d2e4d67b62452ae0d6cae56 and project d40d753f66ec4ed2808aa65b825e66f8. Resources: {'key_pairs'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 02:07:49.357960 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-8602101c-8969-46a8-bca6-15a25e648e28 req-743fc7bf-4ff3-457d-b37f-ccd44cdafa17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa8e11a7-f659-4bd6-a2ad-3327d14d3706", "name": "network-vif-deleted", "tag": "b5387eb9-1e00-436a-99d1-db7408aa68eb"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:07:49.360322 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2d319c12-427d-477e-80be-21da412fd5c8 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.086977 Jun 08 02:07:49.361440 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 160/306] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jun 8 02:07:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:07:49.380561 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-8602101c-8969-46a8-bca6-15a25e648e28 req-743fc7bf-4ff3-457d-b37f-ccd44cdafa17 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:49.381008 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-8602101c-8969-46a8-bca6-15a25e648e28 req-743fc7bf-4ff3-457d-b37f-ccd44cdafa17 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:49.396447 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-8602101c-8969-46a8-bca6-15a25e648e28 req-743fc7bf-4ff3-457d-b37f-ccd44cdafa17 service nova] Creating event network-vif-deleted:b5387eb9-1e00-436a-99d1-db7408aa68eb for instance aa8e11a7-f659-4bd6-a2ad-3327d14d3706 on hv-cinder-84506 Jun 08 02:07:49.402047 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-8602101c-8969-46a8-bca6-15a25e648e28 req-743fc7bf-4ff3-457d-b37f-ccd44cdafa17 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048226 Jun 08 02:07:49.402735 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 147/307] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:07:50.076908 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a354e965-25fd-4dfe-a681-b83b3039a3e5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:50.078648 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a354e965-25fd-4dfe-a681-b83b3039a3e5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:50.085192 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:07:50.093996 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a354e965-25fd-4dfe-a681-b83b3039a3e5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:50.094884 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a354e965-25fd-4dfe-a681-b83b3039a3e5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:50.096757 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a354e965-25fd-4dfe-a681-b83b3039a3e5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:50.097938 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a354e965-25fd-4dfe-a681-b83b3039a3e5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:50.296528 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e7b89c98-82d5-4a4c-969b-fbbad34d77f0 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:50.299161 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e7b89c98-82d5-4a4c-969b-fbbad34d77f0 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] [instance: aa8e11a7-f659-4bd6-a2ad-3327d14d3706] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:50.323519 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e7b89c98-82d5-4a4c-969b-fbbad34d77f0 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:50.324816 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e7b89c98-82d5-4a4c-969b-fbbad34d77f0 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:50.325681 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e7b89c98-82d5-4a4c-969b-fbbad34d77f0 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:50.326127 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e7b89c98-82d5-4a4c-969b-fbbad34d77f0 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:50.381419 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-e7b89c98-82d5-4a4c-969b-fbbad34d77f0 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] HTTP exception thrown: Instance aa8e11a7-f659-4bd6-a2ad-3327d14d3706 could not be found. Jun 08 02:07:50.384424 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e7b89c98-82d5-4a4c-969b-fbbad34d77f0 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Request method failure captured: Jun 08 02:07:50.384424 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706 HTTP/1.1 Jun 08 02:07:50.384424 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept: application/json Jun 08 02:07:50.384424 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jun 08 02:07:50.384424 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Connection: close Jun 08 02:07:50.384424 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jun 08 02:07:50.384424 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jun 08 02:07:50.384424 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Host: 10.222.0.20 Jun 08 02:07:50.384424 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jun 08 02:07:50.384424 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jun 08 02:07:50.384424 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABioARCD3gC4Xf_eJlLYUE2JIJEjuOp2ZbSIV0mB4djau1C4NKml2Bt1nVSUoCyWrHqv6kVdrr8cFE7QmNnx71CC-8sSIqMbGjPx2ZbY3F8aRxJAsmAN_45zUkba7lxfpU2N_MjCL19z491fm_j3X06BpSlvve2gXnnV7wU-OzT2y8GXp8 Jun 08 02:07:50.384424 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jun 08 02:07:50.384424 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jun 08 02:07:50.384424 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jun 08 02:07:50.384424 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jun 08 02:07:50.384424 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jun 08 02:07:50.384424 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jun 08 02:07:50.384424 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Id: 540c921edbf24dbeaf13675b583bb464 Jun 08 02:07:50.384424 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-VolumesActionsTest-1280891985 Jun 08 02:07:50.384424 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jun 08 02:07:50.384424 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jun 08 02:07:50.385958 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/540c921edbf24dbeaf13675b583bb464"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_540c921edbf24dbeaf13675b583bb464", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/540c921edbf24dbeaf13675b583bb464"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/540c921edbf24dbeaf13675b583bb464"}]}] Jun 08 02:07:50.385958 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-VolumesActionsTest-1280891985 Jun 08 02:07:50.385958 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 540c921edbf24dbeaf13675b583bb464 Jun 08 02:07:50.385958 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-VolumesActionsTest-1280891985 Jun 08 02:07:50.385958 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User: tempest-VolumesActionsTest-1280891985-project Jun 08 02:07:50.385958 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jun 08 02:07:50.385958 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jun 08 02:07:50.385958 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Id: cc19addacb9c412cb008e243c1fc7ace Jun 08 02:07:50.385958 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-VolumesActionsTest-1280891985-project Jun 08 02:07:50.385958 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: method: > Jun 08 02:07:50.385958 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: exception: Instance aa8e11a7-f659-4bd6-a2ad-3327d14d3706 could not be found. Jun 08 02:07:50.385958 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: action_args: {'id': 'aa8e11a7-f659-4bd6-a2ad-3327d14d3706'} Jun 08 02:07:50.387303 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:07:50.387303 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:07:50.387303 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:07:50.387303 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:07:50.387303 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:07:50.387303 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:07:50.387303 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:07:50.387303 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:07:50.387303 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:07:50.387303 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:07:50.387303 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa8e11a7-f659-4bd6-a2ad-3327d14d3706 could not be found. Jun 08 02:07:50.387303 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:07:50.387303 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:07:50.387303 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:07:50.387303 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:07:50.387303 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:07:50.387303 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:07:50.387303 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:07:50.387303 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:07:50.387303 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:07:50.388791 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:07:50.388791 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 02:07:50.388791 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 02:07:50.388791 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:07:50.388791 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:07:50.388791 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:07:50.388791 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:07:50.388791 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa8e11a7-f659-4bd6-a2ad-3327d14d3706 could not be found. Jun 08 02:07:50.388791 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:07:50.388791 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:07:50.388791 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:07:50.388791 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:07:50.388791 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:07:50.388791 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:07:50.388791 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:07:50.388791 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:07:50.388791 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa8e11a7-f659-4bd6-a2ad-3327d14d3706 could not be found. Jun 08 02:07:50.388791 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:07:50.393070 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e7b89c98-82d5-4a4c-969b-fbbad34d77f0 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] Returning 404 to user: Instance aa8e11a7-f659-4bd6-a2ad-3327d14d3706 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:07:50.395660 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e7b89c98-82d5-4a4c-969b-fbbad34d77f0 tempest-VolumesActionsTest-1280891985 tempest-VolumesActionsTest-1280891985-project] 10.222.0.20 "GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706" status: 404 len: 111 microversion: 2.1 time: 0.107410 Jun 08 02:07:50.396896 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 148/308] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:50 2022] GET /compute/v2.1/servers/aa8e11a7-f659-4bd6-a2ad-3327d14d3706 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 02:07:50.412178 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-27484c02-2b24-4b90-8a53-5b202b65e45f tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:50.413190 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-27484c02-2b24-4b90-8a53-5b202b65e45f tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: dc44145c-7cae-45fa-b339-fd2b3c42e275] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:50.424860 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a354e965-25fd-4dfe-a681-b83b3039a3e5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:50.440068 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-27484c02-2b24-4b90-8a53-5b202b65e45f tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:50.440759 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-27484c02-2b24-4b90-8a53-5b202b65e45f tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:50.442024 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-27484c02-2b24-4b90-8a53-5b202b65e45f tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:50.442475 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-27484c02-2b24-4b90-8a53-5b202b65e45f tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:50.450561 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a354e965-25fd-4dfe-a681-b83b3039a3e5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1723 microversion: 2.1 time: 0.379115 Jun 08 02:07:50.466915 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 161/309] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:50 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1723 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:51.007784 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-27484c02-2b24-4b90-8a53-5b202b65e45f tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:51.015111 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-84052490-1b5b-4dec-a731-82f014fda708 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Action: 'create', calling method: .version_select at 0x7f83700cda60>, body: {"keypair": {"name": "tempest-TestShelveInstance-2096472055", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBIWhUN03w08j2PFCxRizZDghizs9U0aLjbBdgbk1mAXeh2rHnTZ53EKvOhznGpz/vyggQ6kud9/mX7EtFXljlkBRQM6boUEsdsAGVVh9+t8I4rZ3NHwuf3PnvSavxohA=="}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:07:51.030244 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-27484c02-2b24-4b90-8a53-5b202b65e45f tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275" status: 200 len: 1318 microversion: 2.1 time: 0.631082 Jun 08 02:07:51.034605 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 149/310] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:50 2022] GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275 => generated 1318 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:51.060208 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-84052490-1b5b-4dec-a731-82f014fda708 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Getting quotas for project 43e5d438bb1f4eb28d3f3f68d77b5dee. Resources: {'key_pairs'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 02:07:51.067833 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-84052490-1b5b-4dec-a731-82f014fda708 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Getting quotas for user 00c126e7436243559b25981f5ca7c74e and project 43e5d438bb1f4eb28d3f3f68d77b5dee. Resources: {'key_pairs'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 02:07:51.119593 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-84052490-1b5b-4dec-a731-82f014fda708 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.593642 Jun 08 02:07:51.120555 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 162/311] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jun 8 02:07:50 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 02:07:51.472082 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8f2f648b-b1c5-470b-80bf-102a7a6f9a84 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:51.473343 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8f2f648b-b1c5-470b-80bf-102a7a6f9a84 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:51.476432 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:07:51.489023 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8f2f648b-b1c5-470b-80bf-102a7a6f9a84 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:51.489752 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8f2f648b-b1c5-470b-80bf-102a7a6f9a84 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:51.490715 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8f2f648b-b1c5-470b-80bf-102a7a6f9a84 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:51.492797 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8f2f648b-b1c5-470b-80bf-102a7a6f9a84 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:51.781811 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8f2f648b-b1c5-470b-80bf-102a7a6f9a84 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:51.794357 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8f2f648b-b1c5-470b-80bf-102a7a6f9a84 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1723 microversion: 2.1 time: 0.326219 Jun 08 02:07:51.795629 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 150/312] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:51 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1723 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:51.954832 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-c1924482-65a9-480d-ba0b-277f4c5be667 req-e90791b6-10f9-4a7a-b6fa-fa7cedc40a11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc44145c-7cae-45fa-b339-fd2b3c42e275", "tag": "f93bc63e-095b-4667-bb36-f91a3d9f2379"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:07:51.976816 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-c1924482-65a9-480d-ba0b-277f4c5be667 req-e90791b6-10f9-4a7a-b6fa-fa7cedc40a11 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:51.978047 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-c1924482-65a9-480d-ba0b-277f4c5be667 req-e90791b6-10f9-4a7a-b6fa-fa7cedc40a11 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:52.001568 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-c1924482-65a9-480d-ba0b-277f4c5be667 req-e90791b6-10f9-4a7a-b6fa-fa7cedc40a11 service nova] Creating event network-changed:f93bc63e-095b-4667-bb36-f91a3d9f2379 for instance dc44145c-7cae-45fa-b339-fd2b3c42e275 on hv-cinder-84506 Jun 08 02:07:52.010129 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-c1924482-65a9-480d-ba0b-277f4c5be667 req-e90791b6-10f9-4a7a-b6fa-fa7cedc40a11 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060923 Jun 08 02:07:52.012434 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 163/313] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:07:52.018404 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-333aaf7e-552b-4f9a-9f40-191c81346909 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1418888456", "imageRef": "e648e482-e374-429d-8152-a4a63797f314", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eafc844b-6465-4613-a6dd-f1b9698164f0"}], "security_groups": [{"name": "tempest-securitygroup--614912680"}], "key_name": "tempest-keypair-883393138", "user_data": "}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:07:52.055582 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e2c55863-5a52-4f74-b9ac-29d4a5d810ce tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:52.056495 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e2c55863-5a52-4f74-b9ac-29d4a5d810ce tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: dc44145c-7cae-45fa-b339-fd2b3c42e275] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:52.067329 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e2c55863-5a52-4f74-b9ac-29d4a5d810ce tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:52.068045 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e2c55863-5a52-4f74-b9ac-29d4a5d810ce tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:52.069132 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e2c55863-5a52-4f74-b9ac-29d4a5d810ce tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:52.069757 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e2c55863-5a52-4f74-b9ac-29d4a5d810ce tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:52.108072 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:07:52.275968 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.network.neutron [None req-333aaf7e-552b-4f9a-9f40-191c81346909 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] validate_networks() for [('eafc844b-6465-4613-a6dd-f1b9698164f0', None, None, None, None, None)] {{(pid=117938) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 02:07:52.449780 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e2c55863-5a52-4f74-b9ac-29d4a5d810ce tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:52.460065 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e2c55863-5a52-4f74-b9ac-29d4a5d810ce tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275" status: 200 len: 1318 microversion: 2.1 time: 0.412019 Jun 08 02:07:52.462076 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 164/314] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:52 2022] GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275 => generated 1318 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:52.816175 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a32beec8-9d8f-400f-9bac-0cb9898c2296 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:52.816830 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a32beec8-9d8f-400f-9bac-0cb9898c2296 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:52.827303 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a32beec8-9d8f-400f-9bac-0cb9898c2296 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:52.827848 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a32beec8-9d8f-400f-9bac-0cb9898c2296 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:52.828966 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a32beec8-9d8f-400f-9bac-0cb9898c2296 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:52.829638 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a32beec8-9d8f-400f-9bac-0cb9898c2296 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:53.113474 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-333aaf7e-552b-4f9a-9f40-191c81346909 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Flavor limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 02:07:53.114069 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-333aaf7e-552b-4f9a-9f40-191c81346909 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Image limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 02:07:53.114357 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-333aaf7e-552b-4f9a-9f40-191c81346909 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Flavor pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 02:07:53.114765 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-333aaf7e-552b-4f9a-9f40-191c81346909 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Image pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 02:07:53.115178 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-333aaf7e-552b-4f9a-9f40-191c81346909 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 02:07:53.135534 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-333aaf7e-552b-4f9a-9f40-191c81346909 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:53.136001 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-333aaf7e-552b-4f9a-9f40-191c81346909 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:53.136859 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-333aaf7e-552b-4f9a-9f40-191c81346909 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:53.137302 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-333aaf7e-552b-4f9a-9f40-191c81346909 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:53.179292 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-333aaf7e-552b-4f9a-9f40-191c81346909 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Getting quotas for project d40d753f66ec4ed2808aa65b825e66f8. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 02:07:53.186606 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-333aaf7e-552b-4f9a-9f40-191c81346909 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Getting quotas for user 9e13bd970d2e4d67b62452ae0d6cae56 and project d40d753f66ec4ed2808aa65b825e66f8. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 02:07:53.201582 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-333aaf7e-552b-4f9a-9f40-191c81346909 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Going to run 1 instances... {{(pid=117938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 02:07:53.204285 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-333aaf7e-552b-4f9a-9f40-191c81346909 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e648e482-e374-429d-8152-a4a63797f314',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 02:07:53.266390 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-333aaf7e-552b-4f9a-9f40-191c81346909 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.254462 Jun 08 02:07:53.273498 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 151/315] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jun 8 02:07:52 2022] POST /compute/v2.1/servers => generated 408 bytes in 1262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 08 02:07:53.279913 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0825bda4-338a-4dfb-b07f-58f8d2e43d43 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:53.280797 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0825bda4-338a-4dfb-b07f-58f8d2e43d43 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:53.304534 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a32beec8-9d8f-400f-9bac-0cb9898c2296 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:53.317978 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a32beec8-9d8f-400f-9bac-0cb9898c2296 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1723 microversion: 2.1 time: 0.502399 Jun 08 02:07:53.318695 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 165/316] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:52 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1723 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:53.372865 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0825bda4-338a-4dfb-b07f-58f8d2e43d43 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:53.382980 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0825bda4-338a-4dfb-b07f-58f8d2e43d43 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1245 microversion: 2.1 time: 0.107906 Jun 08 02:07:53.383673 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 152/317] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:53 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1245 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:53.478611 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-bf6930b7-138d-4214-8d8a-91d25c78dcbd tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:53.479227 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-bf6930b7-138d-4214-8d8a-91d25c78dcbd tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: dc44145c-7cae-45fa-b339-fd2b3c42e275] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:53.490101 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bf6930b7-138d-4214-8d8a-91d25c78dcbd tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:53.490611 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bf6930b7-138d-4214-8d8a-91d25c78dcbd tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:53.491989 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bf6930b7-138d-4214-8d8a-91d25c78dcbd tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:53.493304 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bf6930b7-138d-4214-8d8a-91d25c78dcbd tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:53.695082 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-bf6930b7-138d-4214-8d8a-91d25c78dcbd tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:53.703007 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-bf6930b7-138d-4214-8d8a-91d25c78dcbd tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275" status: 200 len: 1318 microversion: 2.1 time: 0.228277 Jun 08 02:07:53.703578 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 166/318] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:53 2022] GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:54.336152 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a4e80ccb-e03a-43f4-9760-8d53257ddf96 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:54.336740 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a4e80ccb-e03a-43f4-9760-8d53257ddf96 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:54.343143 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a4e80ccb-e03a-43f4-9760-8d53257ddf96 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:54.343589 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a4e80ccb-e03a-43f4-9760-8d53257ddf96 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:54.344378 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a4e80ccb-e03a-43f4-9760-8d53257ddf96 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:54.344834 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a4e80ccb-e03a-43f4-9760-8d53257ddf96 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:54.400265 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c6cbc4c5-d9b8-48af-83d9-edfc31c32765 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:54.400896 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c6cbc4c5-d9b8-48af-83d9-edfc31c32765 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:54.406900 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c6cbc4c5-d9b8-48af-83d9-edfc31c32765 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:54.407343 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c6cbc4c5-d9b8-48af-83d9-edfc31c32765 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:54.409687 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c6cbc4c5-d9b8-48af-83d9-edfc31c32765 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:54.409687 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c6cbc4c5-d9b8-48af-83d9-edfc31c32765 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:54.482315 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c6cbc4c5-d9b8-48af-83d9-edfc31c32765 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:54.490427 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c6cbc4c5-d9b8-48af-83d9-edfc31c32765 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1249 microversion: 2.1 time: 0.093848 Jun 08 02:07:54.490997 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 167/319] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:54 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1249 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:07:54.498618 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a4e80ccb-e03a-43f4-9760-8d53257ddf96 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:54.506680 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a4e80ccb-e03a-43f4-9760-8d53257ddf96 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1723 microversion: 2.1 time: 0.174534 Jun 08 02:07:54.507436 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 153/320] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:54 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:54.719999 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-5bac37fd-6b85-4fa9-89fd-87a63220d823 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:54.721175 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-5bac37fd-6b85-4fa9-89fd-87a63220d823 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: dc44145c-7cae-45fa-b339-fd2b3c42e275] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:54.727354 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5bac37fd-6b85-4fa9-89fd-87a63220d823 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:54.728101 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5bac37fd-6b85-4fa9-89fd-87a63220d823 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:54.729292 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5bac37fd-6b85-4fa9-89fd-87a63220d823 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:54.729727 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5bac37fd-6b85-4fa9-89fd-87a63220d823 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:54.877413 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-5bac37fd-6b85-4fa9-89fd-87a63220d823 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:54.886178 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-5bac37fd-6b85-4fa9-89fd-87a63220d823 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275" status: 200 len: 1318 microversion: 2.1 time: 0.169882 Jun 08 02:07:54.887139 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 168/321] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:54 2022] GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:55.507613 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-28bb6321-6702-4924-a014-bb34922e06e7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:55.508952 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-28bb6321-6702-4924-a014-bb34922e06e7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:55.515634 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-28bb6321-6702-4924-a014-bb34922e06e7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:55.516111 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-28bb6321-6702-4924-a014-bb34922e06e7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:55.516911 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-28bb6321-6702-4924-a014-bb34922e06e7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:55.518142 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-28bb6321-6702-4924-a014-bb34922e06e7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:55.523529 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-68998b4c-6b6a-4ddc-b261-f096d5638ad5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:55.524219 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-68998b4c-6b6a-4ddc-b261-f096d5638ad5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:55.531861 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-68998b4c-6b6a-4ddc-b261-f096d5638ad5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:55.532886 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-68998b4c-6b6a-4ddc-b261-f096d5638ad5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:55.534824 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-68998b4c-6b6a-4ddc-b261-f096d5638ad5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:55.535529 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-68998b4c-6b6a-4ddc-b261-f096d5638ad5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:55.599799 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-28bb6321-6702-4924-a014-bb34922e06e7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:55.607512 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-28bb6321-6702-4924-a014-bb34922e06e7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1297 microversion: 2.1 time: 0.103698 Jun 08 02:07:55.608074 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 154/322] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:55 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1297 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:07:55.688213 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-68998b4c-6b6a-4ddc-b261-f096d5638ad5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:55.696744 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-68998b4c-6b6a-4ddc-b261-f096d5638ad5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1723 microversion: 2.1 time: 0.177045 Jun 08 02:07:55.697390 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 169/323] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:55 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:07:55.902899 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8db4f576-73b0-4f54-b69e-fb4084df838d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:55.903633 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8db4f576-73b0-4f54-b69e-fb4084df838d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: dc44145c-7cae-45fa-b339-fd2b3c42e275] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:55.910352 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8db4f576-73b0-4f54-b69e-fb4084df838d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:55.910804 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8db4f576-73b0-4f54-b69e-fb4084df838d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:55.911571 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8db4f576-73b0-4f54-b69e-fb4084df838d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:55.912006 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8db4f576-73b0-4f54-b69e-fb4084df838d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:56.037186 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8db4f576-73b0-4f54-b69e-fb4084df838d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:56.044525 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8db4f576-73b0-4f54-b69e-fb4084df838d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275" status: 200 len: 1318 microversion: 2.1 time: 0.145367 Jun 08 02:07:56.045079 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 155/324] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:55 2022] GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:56.624837 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-01bd5c80-ce9e-40a0-9571-ca86c2a0850a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:56.625556 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-01bd5c80-ce9e-40a0-9571-ca86c2a0850a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:56.632016 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-01bd5c80-ce9e-40a0-9571-ca86c2a0850a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:56.633397 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-01bd5c80-ce9e-40a0-9571-ca86c2a0850a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:56.634439 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-01bd5c80-ce9e-40a0-9571-ca86c2a0850a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:56.635056 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-01bd5c80-ce9e-40a0-9571-ca86c2a0850a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:56.716785 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2de9c655-54e5-4664-b0f7-75976c6181a3 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:56.718202 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2de9c655-54e5-4664-b0f7-75976c6181a3 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:56.736696 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2de9c655-54e5-4664-b0f7-75976c6181a3 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:56.738678 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2de9c655-54e5-4664-b0f7-75976c6181a3 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:56.739651 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2de9c655-54e5-4664-b0f7-75976c6181a3 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:56.743181 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2de9c655-54e5-4664-b0f7-75976c6181a3 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:56.751217 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:07:56.807103 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-01bd5c80-ce9e-40a0-9571-ca86c2a0850a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:56.825217 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-01bd5c80-ce9e-40a0-9571-ca86c2a0850a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1305 microversion: 2.1 time: 0.199628 Jun 08 02:07:56.826282 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 170/325] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:56 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1305 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:57.061645 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2030f39f-b582-442f-beb2-070ccfdad96a tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:57.062554 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-2030f39f-b582-442f-beb2-070ccfdad96a tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: dc44145c-7cae-45fa-b339-fd2b3c42e275] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:57.070937 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2de9c655-54e5-4664-b0f7-75976c6181a3 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:57.071524 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2030f39f-b582-442f-beb2-070ccfdad96a tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:57.071986 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2030f39f-b582-442f-beb2-070ccfdad96a tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:57.072831 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2030f39f-b582-442f-beb2-070ccfdad96a tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:57.073259 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2030f39f-b582-442f-beb2-070ccfdad96a tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:57.085093 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2de9c655-54e5-4664-b0f7-75976c6181a3 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1723 microversion: 2.1 time: 0.373460 Jun 08 02:07:57.086230 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 156/326] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:56 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1723 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:57.405367 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2030f39f-b582-442f-beb2-070ccfdad96a tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:57.426369 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2030f39f-b582-442f-beb2-070ccfdad96a tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275" status: 200 len: 1318 microversion: 2.1 time: 0.368338 Jun 08 02:07:57.428068 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 171/327] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:57 2022] GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275 => generated 1318 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:07:57.844035 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d9b99b26-ff85-4ab5-a35b-3183d17d2f10 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:57.845882 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d9b99b26-ff85-4ab5-a35b-3183d17d2f10 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:57.853348 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d9b99b26-ff85-4ab5-a35b-3183d17d2f10 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:57.854076 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d9b99b26-ff85-4ab5-a35b-3183d17d2f10 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:57.855006 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d9b99b26-ff85-4ab5-a35b-3183d17d2f10 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:57.855627 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d9b99b26-ff85-4ab5-a35b-3183d17d2f10 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:57.986572 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d9b99b26-ff85-4ab5-a35b-3183d17d2f10 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:57.997674 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d9b99b26-ff85-4ab5-a35b-3183d17d2f10 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1303 microversion: 2.1 time: 0.158165 Jun 08 02:07:57.998260 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 157/328] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:57 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1303 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:58.104078 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-15314cf1-b2d8-40ae-bd5e-c6b1bec60ad2 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:58.105059 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-15314cf1-b2d8-40ae-bd5e-c6b1bec60ad2 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:58.113580 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-15314cf1-b2d8-40ae-bd5e-c6b1bec60ad2 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:58.114116 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-15314cf1-b2d8-40ae-bd5e-c6b1bec60ad2 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:58.114974 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-15314cf1-b2d8-40ae-bd5e-c6b1bec60ad2 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:58.115648 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-15314cf1-b2d8-40ae-bd5e-c6b1bec60ad2 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:58.422758 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-15314cf1-b2d8-40ae-bd5e-c6b1bec60ad2 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:58.440895 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-15314cf1-b2d8-40ae-bd5e-c6b1bec60ad2 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1700 microversion: 2.1 time: 0.336729 Jun 08 02:07:58.442073 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 172/329] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:58 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1700 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:58.457655 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9bf85bd9-ac64-4adb-8d21-e8aee0547345 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:58.458277 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9bf85bd9-ac64-4adb-8d21-e8aee0547345 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: dc44145c-7cae-45fa-b339-fd2b3c42e275] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:58.459066 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e9f7ea62-0afe-4b02-8d9f-030346b437ad tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:07:58.466039 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9bf85bd9-ac64-4adb-8d21-e8aee0547345 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:58.466754 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9bf85bd9-ac64-4adb-8d21-e8aee0547345 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:58.467710 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9bf85bd9-ac64-4adb-8d21-e8aee0547345 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:58.468137 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e9f7ea62-0afe-4b02-8d9f-030346b437ad tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:58.468533 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9bf85bd9-ac64-4adb-8d21-e8aee0547345 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:58.469093 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e9f7ea62-0afe-4b02-8d9f-030346b437ad tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:58.568151 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e9f7ea62-0afe-4b02-8d9f-030346b437ad tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Going to try to start instance {{(pid=117939) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 08 02:07:58.630156 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e9f7ea62-0afe-4b02-8d9f-030346b437ad tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "POST /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380/action" status: 202 len: 0 microversion: 2.1 time: 0.176179 Jun 08 02:07:58.631629 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 173/330] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jun 8 02:07:58 2022] POST /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 02:07:58.657123 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-08fdf21b-5cd5-4b3e-8f7e-90c65d8de537 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:58.660363 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-08fdf21b-5cd5-4b3e-8f7e-90c65d8de537 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:58.682149 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-08fdf21b-5cd5-4b3e-8f7e-90c65d8de537 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:58.682608 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-08fdf21b-5cd5-4b3e-8f7e-90c65d8de537 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:58.683404 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-08fdf21b-5cd5-4b3e-8f7e-90c65d8de537 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:58.683823 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-08fdf21b-5cd5-4b3e-8f7e-90c65d8de537 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:59.335013 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-08fdf21b-5cd5-4b3e-8f7e-90c65d8de537 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:59.347743 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-08fdf21b-5cd5-4b3e-8f7e-90c65d8de537 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1709 microversion: 2.1 time: 0.711900 Jun 08 02:07:59.349192 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 174/331] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:58 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1709 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:07:59.355872 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b3e1ca17-afc7-4c9f-a94a-357896731e7d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:07:59.356510 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-b3e1ca17-afc7-4c9f-a94a-357896731e7d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:07:59.381500 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b3e1ca17-afc7-4c9f-a94a-357896731e7d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:59.382270 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b3e1ca17-afc7-4c9f-a94a-357896731e7d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:59.383360 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b3e1ca17-afc7-4c9f-a94a-357896731e7d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:07:59.383809 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b3e1ca17-afc7-4c9f-a94a-357896731e7d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:07:59.412822 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9bf85bd9-ac64-4adb-8d21-e8aee0547345 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:59.424548 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9bf85bd9-ac64-4adb-8d21-e8aee0547345 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275" status: 200 len: 1318 microversion: 2.1 time: 0.982065 Jun 08 02:07:59.429160 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 158/332] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:58 2022] GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275 => generated 1318 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:07:59.716895 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b3e1ca17-afc7-4c9f-a94a-357896731e7d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:07:59.732003 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-b3e1ca17-afc7-4c9f-a94a-357896731e7d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1370 microversion: 2.1 time: 0.373331 Jun 08 02:07:59.733059 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 175/333] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:07:59 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1370 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:08:00.211515 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-8934069a-cd72-4a31-8fa6-fe1b95cf2b08 req-22aa0c06-dd5f-4dfe-b5d1-2f6a4b351285 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "596fe635-9554-4305-b88e-67139f06a3d0", "tag": "d96f59a2-4ec1-4327-b308-e50814a9bbc5"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:08:00.225561 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-8934069a-cd72-4a31-8fa6-fe1b95cf2b08 req-22aa0c06-dd5f-4dfe-b5d1-2f6a4b351285 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:00.228313 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-8934069a-cd72-4a31-8fa6-fe1b95cf2b08 req-22aa0c06-dd5f-4dfe-b5d1-2f6a4b351285 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:00.244639 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-8934069a-cd72-4a31-8fa6-fe1b95cf2b08 req-22aa0c06-dd5f-4dfe-b5d1-2f6a4b351285 service nova] Creating event network-changed:d96f59a2-4ec1-4327-b308-e50814a9bbc5 for instance 596fe635-9554-4305-b88e-67139f06a3d0 on hv-cinder-84506 Jun 08 02:08:00.250968 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-8934069a-cd72-4a31-8fa6-fe1b95cf2b08 req-22aa0c06-dd5f-4dfe-b5d1-2f6a4b351285 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051593 Jun 08 02:08:00.252769 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 159/334] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:08:00.388906 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-5e8a2e8d-c924-4b16-9698-f60361dce6c8 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:00.390846 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-5e8a2e8d-c924-4b16-9698-f60361dce6c8 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:00.410681 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5e8a2e8d-c924-4b16-9698-f60361dce6c8 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:00.418272 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5e8a2e8d-c924-4b16-9698-f60361dce6c8 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:00.431161 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5e8a2e8d-c924-4b16-9698-f60361dce6c8 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:00.433845 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5e8a2e8d-c924-4b16-9698-f60361dce6c8 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:00.448038 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-900e3934-da37-4f8e-b06e-ad9a47b893ea tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:00.448984 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-900e3934-da37-4f8e-b06e-ad9a47b893ea tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: dc44145c-7cae-45fa-b339-fd2b3c42e275] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:00.464388 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-900e3934-da37-4f8e-b06e-ad9a47b893ea tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:00.466219 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-900e3934-da37-4f8e-b06e-ad9a47b893ea tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:00.468363 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-900e3934-da37-4f8e-b06e-ad9a47b893ea tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:00.469452 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-900e3934-da37-4f8e-b06e-ad9a47b893ea tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:00.935912 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-900e3934-da37-4f8e-b06e-ad9a47b893ea tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:00.941873 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-5e8a2e8d-c924-4b16-9698-f60361dce6c8 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:00.949514 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-900e3934-da37-4f8e-b06e-ad9a47b893ea tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275" status: 200 len: 1318 microversion: 2.1 time: 0.503458 Jun 08 02:08:00.950798 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 160/335] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:00 2022] GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275 => generated 1318 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:08:00.952925 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-5e8a2e8d-c924-4b16-9698-f60361dce6c8 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1709 microversion: 2.1 time: 0.580371 Jun 08 02:08:00.963621 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d86a9ac1-a689-45c2-963b-2c0e93249f61 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:00.964585 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d86a9ac1-a689-45c2-963b-2c0e93249f61 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:00.968861 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 176/336] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:00 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1709 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:08:00.984197 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d86a9ac1-a689-45c2-963b-2c0e93249f61 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:00.984687 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d86a9ac1-a689-45c2-963b-2c0e93249f61 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:00.985563 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d86a9ac1-a689-45c2-963b-2c0e93249f61 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:00.989473 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d86a9ac1-a689-45c2-963b-2c0e93249f61 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:01.139068 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d86a9ac1-a689-45c2-963b-2c0e93249f61 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:01.146871 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d86a9ac1-a689-45c2-963b-2c0e93249f61 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1370 microversion: 2.1 time: 0.193180 Jun 08 02:08:01.147438 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 161/337] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:00 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1370 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:08:01.277565 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-032761e2-cebb-47b7-b2c0-8ef8ee299e86 req-5a3dbf93-c0b6-460c-ad5b-962ae2d3fc71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc44145c-7cae-45fa-b339-fd2b3c42e275", "name": "network-vif-plugged", "status": "completed", "tag": "f93bc63e-095b-4667-bb36-f91a3d9f2379"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:08:01.281387 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=10 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:08:01.290474 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-032761e2-cebb-47b7-b2c0-8ef8ee299e86 req-5a3dbf93-c0b6-460c-ad5b-962ae2d3fc71 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:01.290932 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-032761e2-cebb-47b7-b2c0-8ef8ee299e86 req-5a3dbf93-c0b6-460c-ad5b-962ae2d3fc71 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:01.306015 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-032761e2-cebb-47b7-b2c0-8ef8ee299e86 req-5a3dbf93-c0b6-460c-ad5b-962ae2d3fc71 service nova] Creating event network-vif-plugged:f93bc63e-095b-4667-bb36-f91a3d9f2379 for instance dc44145c-7cae-45fa-b339-fd2b3c42e275 on hv-cinder-84506 Jun 08 02:08:01.310988 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-032761e2-cebb-47b7-b2c0-8ef8ee299e86 req-5a3dbf93-c0b6-460c-ad5b-962ae2d3fc71 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037164 Jun 08 02:08:01.311647 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 177/338] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:08:01.982118 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f859181b-6e58-4100-afd7-da82f549b79c tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:01.983521 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f859181b-6e58-4100-afd7-da82f549b79c tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: dc44145c-7cae-45fa-b339-fd2b3c42e275] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:01.998250 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ecc27000-f297-40ff-8eb6-b15a2d0817ce tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:02.001165 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ecc27000-f297-40ff-8eb6-b15a2d0817ce tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:02.002123 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f859181b-6e58-4100-afd7-da82f549b79c tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:02.004014 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f859181b-6e58-4100-afd7-da82f549b79c tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:02.007125 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f859181b-6e58-4100-afd7-da82f549b79c tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:02.010118 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f859181b-6e58-4100-afd7-da82f549b79c tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:02.038628 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ecc27000-f297-40ff-8eb6-b15a2d0817ce tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:02.040655 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ecc27000-f297-40ff-8eb6-b15a2d0817ce tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:02.041707 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ecc27000-f297-40ff-8eb6-b15a2d0817ce tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:02.042153 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ecc27000-f297-40ff-8eb6-b15a2d0817ce tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:02.435844 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f859181b-6e58-4100-afd7-da82f549b79c tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:02.445156 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f859181b-6e58-4100-afd7-da82f549b79c tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275" status: 200 len: 1318 microversion: 2.1 time: 0.480445 Jun 08 02:08:02.448882 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ecc27000-f297-40ff-8eb6-b15a2d0817ce tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:02.455362 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 162/339] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:01 2022] GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275 => generated 1318 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:08:02.460022 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ecc27000-f297-40ff-8eb6-b15a2d0817ce tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1713 microversion: 2.1 time: 0.491688 Jun 08 02:08:02.460200 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f1b18757-a7dc-489f-9aa5-892a40068aca tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:02.460685 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f1b18757-a7dc-489f-9aa5-892a40068aca tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:02.467052 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f1b18757-a7dc-489f-9aa5-892a40068aca tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:02.467752 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f1b18757-a7dc-489f-9aa5-892a40068aca tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:02.468758 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f1b18757-a7dc-489f-9aa5-892a40068aca tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:02.469368 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f1b18757-a7dc-489f-9aa5-892a40068aca tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:02.474014 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 178/340] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:01 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1713 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:08:02.733483 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f1b18757-a7dc-489f-9aa5-892a40068aca tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:02.743389 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f1b18757-a7dc-489f-9aa5-892a40068aca tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1370 microversion: 2.1 time: 0.286836 Jun 08 02:08:02.753360 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 163/341] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:02 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1370 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:08:03.463043 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-912fa5fe-e868-4a00-8edf-e84f141d7c1d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:03.463655 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-912fa5fe-e868-4a00-8edf-e84f141d7c1d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: dc44145c-7cae-45fa-b339-fd2b3c42e275] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:03.471280 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-912fa5fe-e868-4a00-8edf-e84f141d7c1d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:03.471821 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-912fa5fe-e868-4a00-8edf-e84f141d7c1d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:03.472760 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-912fa5fe-e868-4a00-8edf-e84f141d7c1d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:03.473255 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-912fa5fe-e868-4a00-8edf-e84f141d7c1d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:03.619143 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-912fa5fe-e868-4a00-8edf-e84f141d7c1d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:03.626717 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-912fa5fe-e868-4a00-8edf-e84f141d7c1d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275" status: 200 len: 1318 microversion: 2.1 time: 0.168015 Jun 08 02:08:03.627438 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 179/342] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:03 2022] GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:08:03.760589 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a54e6580-56fe-43c5-8f7b-35dbf4326444 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:03.761193 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a54e6580-56fe-43c5-8f7b-35dbf4326444 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:03.766202 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=4 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:08:03.767764 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=14 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:08:03.772070 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a54e6580-56fe-43c5-8f7b-35dbf4326444 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:03.772543 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a54e6580-56fe-43c5-8f7b-35dbf4326444 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:03.773338 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a54e6580-56fe-43c5-8f7b-35dbf4326444 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:03.773810 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a54e6580-56fe-43c5-8f7b-35dbf4326444 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:03.924818 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a54e6580-56fe-43c5-8f7b-35dbf4326444 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:03.936605 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a54e6580-56fe-43c5-8f7b-35dbf4326444 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1370 microversion: 2.1 time: 0.180004 Jun 08 02:08:03.937481 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 164/343] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:03 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:08:04.645031 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-4a9d6470-8580-4b75-9cdb-6aaac6192bdc tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:04.645846 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-4a9d6470-8580-4b75-9cdb-6aaac6192bdc tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: dc44145c-7cae-45fa-b339-fd2b3c42e275] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:04.654667 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4a9d6470-8580-4b75-9cdb-6aaac6192bdc tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:04.655118 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4a9d6470-8580-4b75-9cdb-6aaac6192bdc tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:04.655910 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4a9d6470-8580-4b75-9cdb-6aaac6192bdc tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:04.656367 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4a9d6470-8580-4b75-9cdb-6aaac6192bdc tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:04.797543 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-4a9d6470-8580-4b75-9cdb-6aaac6192bdc tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:04.799900 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:08:04.807817 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-4a9d6470-8580-4b75-9cdb-6aaac6192bdc tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275" status: 200 len: 1508 microversion: 2.1 time: 0.166960 Jun 08 02:08:04.808315 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 180/344] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:04 2022] GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:08:04.955564 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f9b91303-86d7-42e9-9ac7-0288dcb9a39e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:04.956214 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f9b91303-86d7-42e9-9ac7-0288dcb9a39e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:04.964492 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f9b91303-86d7-42e9-9ac7-0288dcb9a39e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:04.964982 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f9b91303-86d7-42e9-9ac7-0288dcb9a39e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:04.966258 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f9b91303-86d7-42e9-9ac7-0288dcb9a39e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:04.967040 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f9b91303-86d7-42e9-9ac7-0288dcb9a39e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:05.113119 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f9b91303-86d7-42e9-9ac7-0288dcb9a39e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:05.120670 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f9b91303-86d7-42e9-9ac7-0288dcb9a39e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1370 microversion: 2.1 time: 0.169643 Jun 08 02:08:05.121244 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 165/345] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:04 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:08:06.137547 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-66bc9c61-e6b8-46d8-857e-d5c036bd2ead tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:06.138927 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-66bc9c61-e6b8-46d8-857e-d5c036bd2ead tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:06.146681 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-66bc9c61-e6b8-46d8-857e-d5c036bd2ead tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:06.147210 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-66bc9c61-e6b8-46d8-857e-d5c036bd2ead tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:06.148049 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-66bc9c61-e6b8-46d8-857e-d5c036bd2ead tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:06.148740 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-66bc9c61-e6b8-46d8-857e-d5c036bd2ead tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:06.401134 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-66bc9c61-e6b8-46d8-857e-d5c036bd2ead tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:06.410464 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-66bc9c61-e6b8-46d8-857e-d5c036bd2ead tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1370 microversion: 2.1 time: 0.277021 Jun 08 02:08:06.411729 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 181/346] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:06 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1370 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:08:07.427998 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-eaa33c9f-dce9-4e50-8301-67774f3b024d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:07.428723 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-eaa33c9f-dce9-4e50-8301-67774f3b024d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:07.435046 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eaa33c9f-dce9-4e50-8301-67774f3b024d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:07.435482 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eaa33c9f-dce9-4e50-8301-67774f3b024d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:07.436250 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eaa33c9f-dce9-4e50-8301-67774f3b024d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:07.436873 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eaa33c9f-dce9-4e50-8301-67774f3b024d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:07.596108 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-eaa33c9f-dce9-4e50-8301-67774f3b024d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:07.606463 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-eaa33c9f-dce9-4e50-8301-67774f3b024d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1370 microversion: 2.1 time: 0.182411 Jun 08 02:08:07.607137 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 166/347] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:07 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1370 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:08:08.626196 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-10a101aa-0f6a-4787-b27a-de4ddcd12419 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:08.627031 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-10a101aa-0f6a-4787-b27a-de4ddcd12419 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:08.634699 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-10a101aa-0f6a-4787-b27a-de4ddcd12419 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:08.635247 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-10a101aa-0f6a-4787-b27a-de4ddcd12419 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:08.636125 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-10a101aa-0f6a-4787-b27a-de4ddcd12419 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:08.636660 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-10a101aa-0f6a-4787-b27a-de4ddcd12419 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:08.773694 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-10a101aa-0f6a-4787-b27a-de4ddcd12419 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:08.781703 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-10a101aa-0f6a-4787-b27a-de4ddcd12419 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1370 microversion: 2.1 time: 0.162506 Jun 08 02:08:08.782467 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 182/348] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:08 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:08:09.800083 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b8343fa4-e493-46bd-a3c4-cc82ca3ef43f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:09.801467 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b8343fa4-e493-46bd-a3c4-cc82ca3ef43f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:09.808041 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b8343fa4-e493-46bd-a3c4-cc82ca3ef43f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:09.808722 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b8343fa4-e493-46bd-a3c4-cc82ca3ef43f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:09.809524 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b8343fa4-e493-46bd-a3c4-cc82ca3ef43f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:09.810149 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b8343fa4-e493-46bd-a3c4-cc82ca3ef43f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:09.962204 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b8343fa4-e493-46bd-a3c4-cc82ca3ef43f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:09.970864 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b8343fa4-e493-46bd-a3c4-cc82ca3ef43f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1370 microversion: 2.1 time: 0.174670 Jun 08 02:08:09.971607 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 167/349] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:09 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:08:10.732483 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ae7240b7-6165-4576-b45c-9854088d605c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:10.733061 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ae7240b7-6165-4576-b45c-9854088d605c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:10.740214 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ae7240b7-6165-4576-b45c-9854088d605c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:10.740584 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ae7240b7-6165-4576-b45c-9854088d605c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:10.741613 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ae7240b7-6165-4576-b45c-9854088d605c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:10.742203 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ae7240b7-6165-4576-b45c-9854088d605c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:10.770397 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ae7240b7-6165-4576-b45c-9854088d605c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56/ips" status: 200 len: 151 microversion: 2.20 time: 0.041722 Jun 08 02:08:10.771142 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 183/350] 10.222.0.20 () {60 vars in 1288 bytes} [Wed Jun 8 02:08:10 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 08 02:08:10.988291 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-45a2540b-cb87-4261-806e-759b50eb6f2d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:10.989864 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-45a2540b-cb87-4261-806e-759b50eb6f2d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:10.997441 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-45a2540b-cb87-4261-806e-759b50eb6f2d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:10.998013 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-45a2540b-cb87-4261-806e-759b50eb6f2d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:10.998881 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-45a2540b-cb87-4261-806e-759b50eb6f2d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:10.999397 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-45a2540b-cb87-4261-806e-759b50eb6f2d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:11.207305 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-45a2540b-cb87-4261-806e-759b50eb6f2d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:11.216385 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-45a2540b-cb87-4261-806e-759b50eb6f2d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1370 microversion: 2.1 time: 0.232378 Jun 08 02:08:11.216989 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 168/351] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:10 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1370 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:08:12.233494 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c1372c78-6af2-4b4b-92e8-c2960e2fcbe7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:12.234712 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c1372c78-6af2-4b4b-92e8-c2960e2fcbe7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:12.241165 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c1372c78-6af2-4b4b-92e8-c2960e2fcbe7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:12.241913 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c1372c78-6af2-4b4b-92e8-c2960e2fcbe7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:12.242750 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c1372c78-6af2-4b4b-92e8-c2960e2fcbe7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:12.243345 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c1372c78-6af2-4b4b-92e8-c2960e2fcbe7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:12.392632 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c1372c78-6af2-4b4b-92e8-c2960e2fcbe7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:12.401289 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c1372c78-6af2-4b4b-92e8-c2960e2fcbe7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1370 microversion: 2.1 time: 0.171523 Jun 08 02:08:12.401864 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 184/352] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:12 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:08:13.295735 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c9588b83-2f94-40a8-a8c0-1c2cbc76fbff tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:08:13.296319 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c9588b83-2f94-40a8-a8c0-1c2cbc76fbff tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:13.304816 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c9588b83-2f94-40a8-a8c0-1c2cbc76fbff tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:13.305504 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c9588b83-2f94-40a8-a8c0-1c2cbc76fbff tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:13.306285 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c9588b83-2f94-40a8-a8c0-1c2cbc76fbff tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:13.306923 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c9588b83-2f94-40a8-a8c0-1c2cbc76fbff tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:13.351149 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-c9588b83-2f94-40a8-a8c0-1c2cbc76fbff tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lazy-loading 'flavor' on Instance uuid b7944f2e-2294-4a69-bd4e-d51f50e73e56 {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 02:08:13.424845 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-6b0d98e4-849f-4e92-8673-0f4ba34a1834 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:13.426542 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-6b0d98e4-849f-4e92-8673-0f4ba34a1834 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:13.438369 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6b0d98e4-849f-4e92-8673-0f4ba34a1834 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:13.438969 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6b0d98e4-849f-4e92-8673-0f4ba34a1834 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:13.439874 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6b0d98e4-849f-4e92-8673-0f4ba34a1834 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:13.440533 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6b0d98e4-849f-4e92-8673-0f4ba34a1834 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:13.597495 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-6b0d98e4-849f-4e92-8673-0f4ba34a1834 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:13.607506 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-6b0d98e4-849f-4e92-8673-0f4ba34a1834 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1370 microversion: 2.1 time: 0.191504 Jun 08 02:08:13.608324 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 185/353] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:13 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1370 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:08:13.750853 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c9588b83-2f94-40a8-a8c0-1c2cbc76fbff tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "POST /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56/action" status: 202 len: 0 microversion: 2.20 time: 0.458824 Jun 08 02:08:13.751470 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 169/354] 10.222.0.20 () {62 vars in 1318 bytes} [Wed Jun 8 02:08:13 2022] POST /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56/action => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 08 02:08:13.759562 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-dd13b081-65ea-4280-a106-6bb1d9496f14 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:13.760165 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-dd13b081-65ea-4280-a106-6bb1d9496f14 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:13.766103 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-dd13b081-65ea-4280-a106-6bb1d9496f14 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:13.766565 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-dd13b081-65ea-4280-a106-6bb1d9496f14 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:13.767307 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-dd13b081-65ea-4280-a106-6bb1d9496f14 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:13.767727 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-dd13b081-65ea-4280-a106-6bb1d9496f14 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:13.904377 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-dd13b081-65ea-4280-a106-6bb1d9496f14 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:13.914075 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-dd13b081-65ea-4280-a106-6bb1d9496f14 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:13.915884 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-dd13b081-65ea-4280-a106-6bb1d9496f14 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:13.917315 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-dd13b081-65ea-4280-a106-6bb1d9496f14 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1724 microversion: 2.20 time: 0.161556 Jun 08 02:08:13.918730 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 186/355] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:08:13 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:08:14.626371 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f5df73db-f8a7-49bd-b732-7d58527572bd tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:14.627141 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f5df73db-f8a7-49bd-b732-7d58527572bd tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:14.635273 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f5df73db-f8a7-49bd-b732-7d58527572bd tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:14.635730 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f5df73db-f8a7-49bd-b732-7d58527572bd tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:14.636555 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f5df73db-f8a7-49bd-b732-7d58527572bd tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:14.636989 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f5df73db-f8a7-49bd-b732-7d58527572bd tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:14.774264 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f5df73db-f8a7-49bd-b732-7d58527572bd tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:14.782075 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f5df73db-f8a7-49bd-b732-7d58527572bd tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1370 microversion: 2.1 time: 0.160887 Jun 08 02:08:14.782636 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 170/356] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:14 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:08:14.937176 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b02ffc53-29f0-4879-8a34-8fb7f1fd2e60 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:14.937774 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-b02ffc53-29f0-4879-8a34-8fb7f1fd2e60 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:14.944300 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b02ffc53-29f0-4879-8a34-8fb7f1fd2e60 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:14.944775 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b02ffc53-29f0-4879-8a34-8fb7f1fd2e60 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:14.945559 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b02ffc53-29f0-4879-8a34-8fb7f1fd2e60 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:14.945983 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b02ffc53-29f0-4879-8a34-8fb7f1fd2e60 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:15.088621 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b02ffc53-29f0-4879-8a34-8fb7f1fd2e60 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:15.097572 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b02ffc53-29f0-4879-8a34-8fb7f1fd2e60 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:15.099712 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b02ffc53-29f0-4879-8a34-8fb7f1fd2e60 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:15.100919 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-b02ffc53-29f0-4879-8a34-8fb7f1fd2e60 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1724 microversion: 2.20 time: 0.167834 Jun 08 02:08:15.101686 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 187/357] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:08:14 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 02:08:15.803343 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-14bde820-8ffd-4d21-9a3b-6a1bcab35833 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:15.803955 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-14bde820-8ffd-4d21-9a3b-6a1bcab35833 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:15.812588 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-14bde820-8ffd-4d21-9a3b-6a1bcab35833 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:15.813083 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-14bde820-8ffd-4d21-9a3b-6a1bcab35833 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:15.813858 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-14bde820-8ffd-4d21-9a3b-6a1bcab35833 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:15.814536 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-14bde820-8ffd-4d21-9a3b-6a1bcab35833 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:15.833130 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:08:15.967789 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-14bde820-8ffd-4d21-9a3b-6a1bcab35833 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:15.975685 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-14bde820-8ffd-4d21-9a3b-6a1bcab35833 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1370 microversion: 2.1 time: 0.179797 Jun 08 02:08:15.976267 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 171/358] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:15 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:08:16.126707 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0c043434-f00d-4bdf-8f6a-052627dd4d6a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:16.127257 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-0c043434-f00d-4bdf-8f6a-052627dd4d6a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:16.134459 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0c043434-f00d-4bdf-8f6a-052627dd4d6a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:16.134897 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0c043434-f00d-4bdf-8f6a-052627dd4d6a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:16.135655 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0c043434-f00d-4bdf-8f6a-052627dd4d6a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:16.136083 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0c043434-f00d-4bdf-8f6a-052627dd4d6a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:16.280537 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-0c043434-f00d-4bdf-8f6a-052627dd4d6a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:16.289119 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-0c043434-f00d-4bdf-8f6a-052627dd4d6a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:16.290763 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-0c043434-f00d-4bdf-8f6a-052627dd4d6a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:16.292154 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-0c043434-f00d-4bdf-8f6a-052627dd4d6a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1724 microversion: 2.20 time: 0.169584 Jun 08 02:08:16.292787 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 188/359] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:08:16 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:08:16.993803 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-78b42d6c-63f5-4ca4-8df7-7b300d17328f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:16.995156 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-78b42d6c-63f5-4ca4-8df7-7b300d17328f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:17.005133 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-78b42d6c-63f5-4ca4-8df7-7b300d17328f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:17.005963 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-78b42d6c-63f5-4ca4-8df7-7b300d17328f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:17.011486 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-78b42d6c-63f5-4ca4-8df7-7b300d17328f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:17.012063 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-78b42d6c-63f5-4ca4-8df7-7b300d17328f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:17.172881 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-78b42d6c-63f5-4ca4-8df7-7b300d17328f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:17.183788 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-78b42d6c-63f5-4ca4-8df7-7b300d17328f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1370 microversion: 2.1 time: 0.195106 Jun 08 02:08:17.186232 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 172/360] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:16 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1370 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:08:17.314310 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-5781838c-5d36-4ad2-a183-790949bdc97e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:17.315714 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-5781838c-5d36-4ad2-a183-790949bdc97e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:17.323681 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5781838c-5d36-4ad2-a183-790949bdc97e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:17.329214 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-064ac0e3-f64f-4517-9256-1693631014fa req-ca29fa31-1e52-439e-b817-88fbd6b9ffd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "596fe635-9554-4305-b88e-67139f06a3d0", "name": "network-vif-plugged", "status": "completed", "tag": "d96f59a2-4ec1-4327-b308-e50814a9bbc5"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:08:17.335015 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5781838c-5d36-4ad2-a183-790949bdc97e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:17.337671 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5781838c-5d36-4ad2-a183-790949bdc97e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:17.338193 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5781838c-5d36-4ad2-a183-790949bdc97e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:17.344461 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-064ac0e3-f64f-4517-9256-1693631014fa req-ca29fa31-1e52-439e-b817-88fbd6b9ffd6 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:17.348659 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-064ac0e3-f64f-4517-9256-1693631014fa req-ca29fa31-1e52-439e-b817-88fbd6b9ffd6 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:17.408182 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-064ac0e3-f64f-4517-9256-1693631014fa req-ca29fa31-1e52-439e-b817-88fbd6b9ffd6 service nova] Creating event network-vif-plugged:d96f59a2-4ec1-4327-b308-e50814a9bbc5 for instance 596fe635-9554-4305-b88e-67139f06a3d0 on hv-cinder-84506 Jun 08 02:08:17.420317 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-064ac0e3-f64f-4517-9256-1693631014fa req-ca29fa31-1e52-439e-b817-88fbd6b9ffd6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094755 Jun 08 02:08:17.423181 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 173/361] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:08:17.562868 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-5781838c-5d36-4ad2-a183-790949bdc97e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:17.582867 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-5781838c-5d36-4ad2-a183-790949bdc97e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:17.585498 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-5781838c-5d36-4ad2-a183-790949bdc97e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:17.586851 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-5781838c-5d36-4ad2-a183-790949bdc97e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1724 microversion: 2.20 time: 0.277676 Jun 08 02:08:17.587392 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 189/362] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:08:17 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1724 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:08:18.205045 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c501ae09-b92e-4edb-a7fd-844a9d3adba0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:18.205748 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c501ae09-b92e-4edb-a7fd-844a9d3adba0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:18.214005 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c501ae09-b92e-4edb-a7fd-844a9d3adba0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:18.214478 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c501ae09-b92e-4edb-a7fd-844a9d3adba0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:18.215432 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c501ae09-b92e-4edb-a7fd-844a9d3adba0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:18.215871 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c501ae09-b92e-4edb-a7fd-844a9d3adba0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:18.352828 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c501ae09-b92e-4edb-a7fd-844a9d3adba0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:18.362251 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c501ae09-b92e-4edb-a7fd-844a9d3adba0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1370 microversion: 2.1 time: 0.161410 Jun 08 02:08:18.362913 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 174/363] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:18 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:08:18.609669 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-3d69bade-94cb-4a9b-a61e-3bf8c0d2be48 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:18.610305 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-3d69bade-94cb-4a9b-a61e-3bf8c0d2be48 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:18.616727 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3d69bade-94cb-4a9b-a61e-3bf8c0d2be48 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:18.617139 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3d69bade-94cb-4a9b-a61e-3bf8c0d2be48 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:18.617929 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3d69bade-94cb-4a9b-a61e-3bf8c0d2be48 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:18.618362 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3d69bade-94cb-4a9b-a61e-3bf8c0d2be48 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:18.781309 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-3d69bade-94cb-4a9b-a61e-3bf8c0d2be48 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:18.790230 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-3d69bade-94cb-4a9b-a61e-3bf8c0d2be48 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:18.792056 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-3d69bade-94cb-4a9b-a61e-3bf8c0d2be48 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:18.793595 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-3d69bade-94cb-4a9b-a61e-3bf8c0d2be48 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1724 microversion: 2.20 time: 0.187553 Jun 08 02:08:18.794588 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 190/364] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:08:18 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 02:08:19.380149 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-13e1275b-1cc9-4989-9c03-846b1d649d1e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:19.380697 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-13e1275b-1cc9-4989-9c03-846b1d649d1e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:19.387523 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-13e1275b-1cc9-4989-9c03-846b1d649d1e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:19.391883 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-13e1275b-1cc9-4989-9c03-846b1d649d1e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:19.392929 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-13e1275b-1cc9-4989-9c03-846b1d649d1e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:19.393374 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-13e1275b-1cc9-4989-9c03-846b1d649d1e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:19.534364 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-13e1275b-1cc9-4989-9c03-846b1d649d1e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:19.542580 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-13e1275b-1cc9-4989-9c03-846b1d649d1e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1370 microversion: 2.1 time: 0.167419 Jun 08 02:08:19.543338 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 175/365] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:19 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1370 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:08:19.816083 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-3151bd6d-b36b-4b49-9e9c-ddc7d862491d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:19.817143 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-3151bd6d-b36b-4b49-9e9c-ddc7d862491d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:19.827750 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3151bd6d-b36b-4b49-9e9c-ddc7d862491d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:19.828566 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3151bd6d-b36b-4b49-9e9c-ddc7d862491d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:19.829550 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3151bd6d-b36b-4b49-9e9c-ddc7d862491d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:19.830414 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3151bd6d-b36b-4b49-9e9c-ddc7d862491d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:19.991346 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-3151bd6d-b36b-4b49-9e9c-ddc7d862491d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:19.999920 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-3151bd6d-b36b-4b49-9e9c-ddc7d862491d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:20.001668 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-3151bd6d-b36b-4b49-9e9c-ddc7d862491d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:20.002861 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-3151bd6d-b36b-4b49-9e9c-ddc7d862491d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1724 microversion: 2.20 time: 0.193043 Jun 08 02:08:20.003346 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 191/366] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:08:19 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:08:20.560842 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b093a132-4def-48f3-90e9-4d23bfcce259 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:20.562132 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b093a132-4def-48f3-90e9-4d23bfcce259 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:20.569119 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b093a132-4def-48f3-90e9-4d23bfcce259 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:20.569818 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b093a132-4def-48f3-90e9-4d23bfcce259 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:20.570762 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b093a132-4def-48f3-90e9-4d23bfcce259 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:20.571370 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b093a132-4def-48f3-90e9-4d23bfcce259 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:20.723559 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b093a132-4def-48f3-90e9-4d23bfcce259 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:20.731494 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b093a132-4def-48f3-90e9-4d23bfcce259 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1565 microversion: 2.1 time: 0.175484 Jun 08 02:08:20.732157 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 176/367] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:20 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1565 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:08:20.749546 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-015b067d-0d35-4ae1-8c61-098016b6a594 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:20.750043 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-015b067d-0d35-4ae1-8c61-098016b6a594 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:20.751918 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:08:20.758758 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-015b067d-0d35-4ae1-8c61-098016b6a594 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:20.759265 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-015b067d-0d35-4ae1-8c61-098016b6a594 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:20.760043 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-015b067d-0d35-4ae1-8c61-098016b6a594 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:20.760513 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-015b067d-0d35-4ae1-8c61-098016b6a594 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:20.846390 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-015b067d-0d35-4ae1-8c61-098016b6a594 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101207 Jun 08 02:08:20.847243 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 192/368] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jun 8 02:08:20 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:08:21.024321 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4dd71e86-3316-4006-8a1e-cbe464fa2e04 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:21.024962 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4dd71e86-3316-4006-8a1e-cbe464fa2e04 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:21.032918 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4dd71e86-3316-4006-8a1e-cbe464fa2e04 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:21.033717 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4dd71e86-3316-4006-8a1e-cbe464fa2e04 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:21.034811 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4dd71e86-3316-4006-8a1e-cbe464fa2e04 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:21.035248 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4dd71e86-3316-4006-8a1e-cbe464fa2e04 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:21.360420 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4dd71e86-3316-4006-8a1e-cbe464fa2e04 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:21.373101 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4dd71e86-3316-4006-8a1e-cbe464fa2e04 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:21.374683 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4dd71e86-3316-4006-8a1e-cbe464fa2e04 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:21.375895 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4dd71e86-3316-4006-8a1e-cbe464fa2e04 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1724 microversion: 2.20 time: 0.355805 Jun 08 02:08:21.376757 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 177/369] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:08:21 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1724 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:08:22.397094 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b3d45cf8-35b7-48e0-a774-1ace3ae6319b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:22.398416 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-b3d45cf8-35b7-48e0-a774-1ace3ae6319b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:22.408138 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b3d45cf8-35b7-48e0-a774-1ace3ae6319b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:22.408711 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b3d45cf8-35b7-48e0-a774-1ace3ae6319b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:22.409645 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b3d45cf8-35b7-48e0-a774-1ace3ae6319b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:22.410309 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b3d45cf8-35b7-48e0-a774-1ace3ae6319b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:22.688939 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-d411f3c9-7865-4a52-b447-e9238a0c02e8 req-2656daed-4fb1-4f39-9f0c-5a0efb5cee99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "596fe635-9554-4305-b88e-67139f06a3d0", "tag": "d96f59a2-4ec1-4327-b308-e50814a9bbc5"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:08:22.693867 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:08:22.703201 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b3d45cf8-35b7-48e0-a774-1ace3ae6319b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:22.713518 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-d411f3c9-7865-4a52-b447-e9238a0c02e8 req-2656daed-4fb1-4f39-9f0c-5a0efb5cee99 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:22.714132 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-d411f3c9-7865-4a52-b447-e9238a0c02e8 req-2656daed-4fb1-4f39-9f0c-5a0efb5cee99 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:22.714634 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b3d45cf8-35b7-48e0-a774-1ace3ae6319b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:22.722984 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b3d45cf8-35b7-48e0-a774-1ace3ae6319b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:22.725238 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-b3d45cf8-35b7-48e0-a774-1ace3ae6319b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1724 microversion: 2.20 time: 0.333298 Jun 08 02:08:22.740933 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 193/370] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:08:22 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1724 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 02:08:22.754895 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-d411f3c9-7865-4a52-b447-e9238a0c02e8 req-2656daed-4fb1-4f39-9f0c-5a0efb5cee99 service nova] Creating event network-changed:d96f59a2-4ec1-4327-b308-e50814a9bbc5 for instance 596fe635-9554-4305-b88e-67139f06a3d0 on hv-cinder-84506 Jun 08 02:08:22.762689 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-d411f3c9-7865-4a52-b447-e9238a0c02e8 req-2656daed-4fb1-4f39-9f0c-5a0efb5cee99 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077711 Jun 08 02:08:22.765068 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 178/371] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 02:08:23.748364 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ca45c0a6-cf88-45ab-8af6-172593926ba7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:23.749505 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ca45c0a6-cf88-45ab-8af6-172593926ba7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:23.755692 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ca45c0a6-cf88-45ab-8af6-172593926ba7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:23.756757 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ca45c0a6-cf88-45ab-8af6-172593926ba7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:23.757583 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ca45c0a6-cf88-45ab-8af6-172593926ba7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:23.758017 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ca45c0a6-cf88-45ab-8af6-172593926ba7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:23.905683 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ca45c0a6-cf88-45ab-8af6-172593926ba7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:23.915000 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ca45c0a6-cf88-45ab-8af6-172593926ba7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:23.916324 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ca45c0a6-cf88-45ab-8af6-172593926ba7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:23.917444 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ca45c0a6-cf88-45ab-8af6-172593926ba7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1724 microversion: 2.20 time: 0.174459 Jun 08 02:08:23.917989 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 194/372] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:08:23 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:08:24.936966 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b8d60a15-32d9-4351-b205-b9d84fb9a41e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:24.937661 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b8d60a15-32d9-4351-b205-b9d84fb9a41e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:24.943830 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b8d60a15-32d9-4351-b205-b9d84fb9a41e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:24.944922 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b8d60a15-32d9-4351-b205-b9d84fb9a41e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:24.945807 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b8d60a15-32d9-4351-b205-b9d84fb9a41e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:24.946241 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b8d60a15-32d9-4351-b205-b9d84fb9a41e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:25.083505 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b8d60a15-32d9-4351-b205-b9d84fb9a41e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:25.092524 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b8d60a15-32d9-4351-b205-b9d84fb9a41e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:25.094507 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b8d60a15-32d9-4351-b205-b9d84fb9a41e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:25.095833 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b8d60a15-32d9-4351-b205-b9d84fb9a41e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1724 microversion: 2.20 time: 0.164003 Jun 08 02:08:25.096416 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 179/373] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:08:24 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:08:26.114274 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e828c6dc-5e20-4b74-8323-c51fa2d19321 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:26.115006 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e828c6dc-5e20-4b74-8323-c51fa2d19321 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:26.125672 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e828c6dc-5e20-4b74-8323-c51fa2d19321 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:26.126116 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e828c6dc-5e20-4b74-8323-c51fa2d19321 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:26.126886 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e828c6dc-5e20-4b74-8323-c51fa2d19321 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:26.127569 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e828c6dc-5e20-4b74-8323-c51fa2d19321 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:26.283684 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e828c6dc-5e20-4b74-8323-c51fa2d19321 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:26.292837 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e828c6dc-5e20-4b74-8323-c51fa2d19321 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:26.294708 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e828c6dc-5e20-4b74-8323-c51fa2d19321 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:26.296111 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e828c6dc-5e20-4b74-8323-c51fa2d19321 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1724 microversion: 2.20 time: 0.186051 Jun 08 02:08:26.296965 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 195/374] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:08:26 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:08:27.313845 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8241e7ca-d823-4729-8784-0d7b608a6c81 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:27.314461 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8241e7ca-d823-4729-8784-0d7b608a6c81 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:27.321629 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8241e7ca-d823-4729-8784-0d7b608a6c81 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:27.322331 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8241e7ca-d823-4729-8784-0d7b608a6c81 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:27.323258 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8241e7ca-d823-4729-8784-0d7b608a6c81 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:27.323882 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8241e7ca-d823-4729-8784-0d7b608a6c81 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:27.464210 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8241e7ca-d823-4729-8784-0d7b608a6c81 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:27.472826 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8241e7ca-d823-4729-8784-0d7b608a6c81 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:27.474421 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8241e7ca-d823-4729-8784-0d7b608a6c81 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:27.476337 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8241e7ca-d823-4729-8784-0d7b608a6c81 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1724 microversion: 2.20 time: 0.166534 Jun 08 02:08:27.477563 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 180/375] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:08:27 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:08:28.096374 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-4e3f152c-5dd1-49c5-aca0-6cae9f25031d tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-369557081", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2096472055", "security_groups": [{"name": "tempest-secgroup-smoke-1106259715"}], "networks": [{"uuid": "aee60589-e544-41a2-b3ab-36bcd464e5c3"}], "block_device_mapping_v2": [{"uuid": "77e4a355-a2f5-4227-87df-82e2b6bbda86", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:08:28.241351 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.network.neutron [None req-4e3f152c-5dd1-49c5-aca0-6cae9f25031d tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] validate_networks() for [('aee60589-e544-41a2-b3ab-36bcd464e5c3', None, None, None, None, None)] {{(pid=117939) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 02:08:28.495051 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3eb17355-87b5-4e64-a8db-9ca3f41e9d2d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:28.495644 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3eb17355-87b5-4e64-a8db-9ca3f41e9d2d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:28.502194 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3eb17355-87b5-4e64-a8db-9ca3f41e9d2d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:28.502698 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3eb17355-87b5-4e64-a8db-9ca3f41e9d2d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:28.503492 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3eb17355-87b5-4e64-a8db-9ca3f41e9d2d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:28.503926 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3eb17355-87b5-4e64-a8db-9ca3f41e9d2d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:28.696597 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-4e3f152c-5dd1-49c5-aca0-6cae9f25031d tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Flavor limits 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 02:08:28.697376 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-4e3f152c-5dd1-49c5-aca0-6cae9f25031d tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Image limits 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 02:08:28.698235 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-4e3f152c-5dd1-49c5-aca0-6cae9f25031d tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Flavor pref 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 02:08:28.699016 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-4e3f152c-5dd1-49c5-aca0-6cae9f25031d tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Image pref 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 02:08:28.699673 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-4e3f152c-5dd1-49c5-aca0-6cae9f25031d tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 02:08:28.708805 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4e3f152c-5dd1-49c5-aca0-6cae9f25031d tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:28.709244 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4e3f152c-5dd1-49c5-aca0-6cae9f25031d tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:28.710544 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4e3f152c-5dd1-49c5-aca0-6cae9f25031d tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:28.711070 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4e3f152c-5dd1-49c5-aca0-6cae9f25031d tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:28.713608 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3eb17355-87b5-4e64-a8db-9ca3f41e9d2d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:28.721749 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3eb17355-87b5-4e64-a8db-9ca3f41e9d2d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:28.723345 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3eb17355-87b5-4e64-a8db-9ca3f41e9d2d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:28.724610 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3eb17355-87b5-4e64-a8db-9ca3f41e9d2d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1724 microversion: 2.20 time: 0.233603 Jun 08 02:08:28.726495 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 181/376] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:08:28 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 02:08:28.728247 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-4e3f152c-5dd1-49c5-aca0-6cae9f25031d tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Getting quotas for project 43e5d438bb1f4eb28d3f3f68d77b5dee. Resources: {'cores', 'ram', 'instances'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 02:08:28.732214 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-4e3f152c-5dd1-49c5-aca0-6cae9f25031d tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Getting quotas for user 00c126e7436243559b25981f5ca7c74e and project 43e5d438bb1f4eb28d3f3f68d77b5dee. Resources: {'cores', 'ram', 'instances'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 02:08:28.790986 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-4e3f152c-5dd1-49c5-aca0-6cae9f25031d tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Going to run 1 instances... {{(pid=117939) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 02:08:28.793263 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-4e3f152c-5dd1-49c5-aca0-6cae9f25031d tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='77e4a355-a2f5-4227-87df-82e2b6bbda86',volume_size=None,volume_type=None)] {{(pid=117939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 02:08:28.926432 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-4e3f152c-5dd1-49c5-aca0-6cae9f25031d tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.833936 Jun 08 02:08:28.927136 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 196/377] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jun 8 02:08:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 08 02:08:28.937122 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f42a3ce2-95de-42e0-ab41-9711fc7bac9a tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:28.937738 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f42a3ce2-95de-42e0-ab41-9711fc7bac9a tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:28.995008 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f42a3ce2-95de-42e0-ab41-9711fc7bac9a tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:29.002103 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f42a3ce2-95de-42e0-ab41-9711fc7bac9a tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1088 microversion: 2.1 time: 0.068754 Jun 08 02:08:29.002670 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 182/378] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:28 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:08:29.745715 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a5110b0b-2b75-4b36-a0c7-a7ffdb6936c4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:29.746620 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a5110b0b-2b75-4b36-a0c7-a7ffdb6936c4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:29.753493 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a5110b0b-2b75-4b36-a0c7-a7ffdb6936c4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:29.753941 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a5110b0b-2b75-4b36-a0c7-a7ffdb6936c4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:29.754694 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a5110b0b-2b75-4b36-a0c7-a7ffdb6936c4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:29.755148 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a5110b0b-2b75-4b36-a0c7-a7ffdb6936c4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:29.884737 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a5110b0b-2b75-4b36-a0c7-a7ffdb6936c4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:29.892740 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a5110b0b-2b75-4b36-a0c7-a7ffdb6936c4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:29.894260 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a5110b0b-2b75-4b36-a0c7-a7ffdb6936c4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:29.895437 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a5110b0b-2b75-4b36-a0c7-a7ffdb6936c4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1724 microversion: 2.20 time: 0.154958 Jun 08 02:08:29.895993 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 197/379] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:08:29 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 02:08:30.018702 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-77b35c70-4652-469e-8b30-51922018fc73 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:30.019310 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-77b35c70-4652-469e-8b30-51922018fc73 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:30.026315 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-77b35c70-4652-469e-8b30-51922018fc73 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:30.026758 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-77b35c70-4652-469e-8b30-51922018fc73 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:30.027510 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-77b35c70-4652-469e-8b30-51922018fc73 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:30.027973 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-77b35c70-4652-469e-8b30-51922018fc73 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:30.088045 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-77b35c70-4652-469e-8b30-51922018fc73 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:30.095513 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-77b35c70-4652-469e-8b30-51922018fc73 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1186 microversion: 2.1 time: 0.080624 Jun 08 02:08:30.096075 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 183/380] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:30 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1186 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:08:30.914544 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d1bcbbc1-0416-40e9-afef-60165f8f8704 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:30.916485 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d1bcbbc1-0416-40e9-afef-60165f8f8704 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:30.922870 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d1bcbbc1-0416-40e9-afef-60165f8f8704 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:30.923321 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d1bcbbc1-0416-40e9-afef-60165f8f8704 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:30.924150 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d1bcbbc1-0416-40e9-afef-60165f8f8704 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:30.924653 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d1bcbbc1-0416-40e9-afef-60165f8f8704 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:31.113040 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-95b8a76d-139d-4b80-a6e6-786497c049d9 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:31.113808 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-95b8a76d-139d-4b80-a6e6-786497c049d9 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:31.121291 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-95b8a76d-139d-4b80-a6e6-786497c049d9 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:31.121876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-95b8a76d-139d-4b80-a6e6-786497c049d9 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:31.122772 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-95b8a76d-139d-4b80-a6e6-786497c049d9 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:31.123422 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-95b8a76d-139d-4b80-a6e6-786497c049d9 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:31.153078 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d1bcbbc1-0416-40e9-afef-60165f8f8704 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:31.155274 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=100 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:08:31.167756 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d1bcbbc1-0416-40e9-afef-60165f8f8704 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:31.169416 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d1bcbbc1-0416-40e9-afef-60165f8f8704 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:31.170620 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d1bcbbc1-0416-40e9-afef-60165f8f8704 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1745 microversion: 2.20 time: 0.260671 Jun 08 02:08:31.171161 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 198/381] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:08:30 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1745 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:08:31.201157 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-95b8a76d-139d-4b80-a6e6-786497c049d9 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:31.208707 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-95b8a76d-139d-4b80-a6e6-786497c049d9 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1204 microversion: 2.1 time: 0.099930 Jun 08 02:08:31.210788 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 184/382] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:31 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1204 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:08:31.987455 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-e28a5e1a-9814-4da3-8f24-207ac295c656 req-8200fefb-0216-4058-a94f-66d501da9b2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cf1e158-1c3a-488c-8227-d7279cea2978", "tag": "8bbb59fb-caf5-486d-bd77-92280696e47b"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:08:31.999279 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-e28a5e1a-9814-4da3-8f24-207ac295c656 req-8200fefb-0216-4058-a94f-66d501da9b2b service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:32.000500 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-e28a5e1a-9814-4da3-8f24-207ac295c656 req-8200fefb-0216-4058-a94f-66d501da9b2b service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:32.023607 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-e28a5e1a-9814-4da3-8f24-207ac295c656 req-8200fefb-0216-4058-a94f-66d501da9b2b service nova] Creating event network-changed:8bbb59fb-caf5-486d-bd77-92280696e47b for instance 4cf1e158-1c3a-488c-8227-d7279cea2978 on hv-cinder-84506 Jun 08 02:08:32.028557 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-e28a5e1a-9814-4da3-8f24-207ac295c656 req-8200fefb-0216-4058-a94f-66d501da9b2b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044962 Jun 08 02:08:32.029225 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 199/383] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 02:08:32.188969 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-87585041-d5cc-4fd5-b3ef-9f4bf0e13bec tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:32.189578 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-87585041-d5cc-4fd5-b3ef-9f4bf0e13bec tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:32.196836 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-87585041-d5cc-4fd5-b3ef-9f4bf0e13bec tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:32.197286 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-87585041-d5cc-4fd5-b3ef-9f4bf0e13bec tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:32.198048 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-87585041-d5cc-4fd5-b3ef-9f4bf0e13bec tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:32.198482 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-87585041-d5cc-4fd5-b3ef-9f4bf0e13bec tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:32.227495 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-59f51f63-723c-4c40-9143-a91fe7b4f1a5 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:32.228187 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-59f51f63-723c-4c40-9143-a91fe7b4f1a5 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:32.234637 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-59f51f63-723c-4c40-9143-a91fe7b4f1a5 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:32.235077 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-59f51f63-723c-4c40-9143-a91fe7b4f1a5 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:32.235858 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-59f51f63-723c-4c40-9143-a91fe7b4f1a5 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:32.236270 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-59f51f63-723c-4c40-9143-a91fe7b4f1a5 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:32.688546 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-87585041-d5cc-4fd5-b3ef-9f4bf0e13bec tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:32.697781 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-87585041-d5cc-4fd5-b3ef-9f4bf0e13bec tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:32.699305 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-87585041-d5cc-4fd5-b3ef-9f4bf0e13bec tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:32.700470 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-87585041-d5cc-4fd5-b3ef-9f4bf0e13bec tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1745 microversion: 2.20 time: 0.515365 Jun 08 02:08:32.701026 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 185/384] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:08:32 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1745 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:08:32.718690 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-59f51f63-723c-4c40-9143-a91fe7b4f1a5 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:32.726706 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-59f51f63-723c-4c40-9143-a91fe7b4f1a5 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1260 microversion: 2.1 time: 0.503735 Jun 08 02:08:32.727262 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 200/385] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:32 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1260 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:08:33.718869 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-85279372-b689-4c72-b032-666fcb04ec59 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:33.719503 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-85279372-b689-4c72-b032-666fcb04ec59 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:33.726229 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-85279372-b689-4c72-b032-666fcb04ec59 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:33.726673 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-85279372-b689-4c72-b032-666fcb04ec59 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:33.727435 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-85279372-b689-4c72-b032-666fcb04ec59 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:33.727870 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-85279372-b689-4c72-b032-666fcb04ec59 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:33.744567 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f66b86bd-519b-4a35-b789-39bccc399720 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:33.745213 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f66b86bd-519b-4a35-b789-39bccc399720 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:33.752137 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f66b86bd-519b-4a35-b789-39bccc399720 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:33.752613 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f66b86bd-519b-4a35-b789-39bccc399720 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:33.753369 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f66b86bd-519b-4a35-b789-39bccc399720 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:33.753793 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f66b86bd-519b-4a35-b789-39bccc399720 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:33.924215 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-85279372-b689-4c72-b032-666fcb04ec59 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:33.933734 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f66b86bd-519b-4a35-b789-39bccc399720 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:33.933939 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-85279372-b689-4c72-b032-666fcb04ec59 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:33.935477 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-85279372-b689-4c72-b032-666fcb04ec59 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:33.936687 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-85279372-b689-4c72-b032-666fcb04ec59 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1745 microversion: 2.20 time: 0.221792 Jun 08 02:08:33.937242 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 186/386] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:08:33 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1745 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:08:33.941551 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f66b86bd-519b-4a35-b789-39bccc399720 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1260 microversion: 2.1 time: 0.202500 Jun 08 02:08:33.942101 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 201/387] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:33 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1260 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:08:34.955210 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5d6239cf-8a64-46cd-b19f-52d58dc1b11a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:34.955996 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5d6239cf-8a64-46cd-b19f-52d58dc1b11a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:34.958870 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-485d4d82-6818-4e8a-9dbc-9baf0fc1d736 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:34.959774 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-485d4d82-6818-4e8a-9dbc-9baf0fc1d736 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:34.962839 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5d6239cf-8a64-46cd-b19f-52d58dc1b11a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:34.963319 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5d6239cf-8a64-46cd-b19f-52d58dc1b11a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:34.964093 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5d6239cf-8a64-46cd-b19f-52d58dc1b11a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:34.964587 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5d6239cf-8a64-46cd-b19f-52d58dc1b11a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:34.965784 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-485d4d82-6818-4e8a-9dbc-9baf0fc1d736 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:34.966219 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-485d4d82-6818-4e8a-9dbc-9baf0fc1d736 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:34.966965 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-485d4d82-6818-4e8a-9dbc-9baf0fc1d736 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:34.967390 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-485d4d82-6818-4e8a-9dbc-9baf0fc1d736 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:35.157267 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5d6239cf-8a64-46cd-b19f-52d58dc1b11a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:35.166426 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5d6239cf-8a64-46cd-b19f-52d58dc1b11a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:35.168057 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5d6239cf-8a64-46cd-b19f-52d58dc1b11a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:35.170019 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5d6239cf-8a64-46cd-b19f-52d58dc1b11a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1745 microversion: 2.20 time: 0.218788 Jun 08 02:08:35.170814 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 187/388] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:08:34 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1745 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:08:35.172066 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-485d4d82-6818-4e8a-9dbc-9baf0fc1d736 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:35.180779 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-485d4d82-6818-4e8a-9dbc-9baf0fc1d736 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1260 microversion: 2.1 time: 0.225788 Jun 08 02:08:35.181428 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 202/389] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:34 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1260 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:08:35.430897 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-20ad46fe-0a83-4891-8f60-fd4dea431b92 req-0940a021-e68f-4fa8-b837-c5af566913a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7944f2e-2294-4a69-bd4e-d51f50e73e56", "name": "network-vif-plugged", "status": "completed", "tag": "4c178719-6047-43d9-9d57-30618b0b060e"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:08:35.440063 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-20ad46fe-0a83-4891-8f60-fd4dea431b92 req-0940a021-e68f-4fa8-b837-c5af566913a4 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:35.440667 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-20ad46fe-0a83-4891-8f60-fd4dea431b92 req-0940a021-e68f-4fa8-b837-c5af566913a4 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:35.452171 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-20ad46fe-0a83-4891-8f60-fd4dea431b92 req-0940a021-e68f-4fa8-b837-c5af566913a4 service nova] Creating event network-vif-plugged:4c178719-6047-43d9-9d57-30618b0b060e for instance b7944f2e-2294-4a69-bd4e-d51f50e73e56 on hv-cinder-84506 Jun 08 02:08:35.457593 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-20ad46fe-0a83-4891-8f60-fd4dea431b92 req-0940a021-e68f-4fa8-b837-c5af566913a4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030806 Jun 08 02:08:35.458159 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 188/390] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:08:36.190167 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-7c6bc660-9366-42ed-8b2c-23fff9bc26e4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:36.191424 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-7c6bc660-9366-42ed-8b2c-23fff9bc26e4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:36.199107 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7c6bc660-9366-42ed-8b2c-23fff9bc26e4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:36.199698 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7c6bc660-9366-42ed-8b2c-23fff9bc26e4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:36.200666 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7c6bc660-9366-42ed-8b2c-23fff9bc26e4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:36.200977 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6dbcee19-4286-443b-909f-94f346a59199 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:36.201426 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7c6bc660-9366-42ed-8b2c-23fff9bc26e4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:36.202503 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6dbcee19-4286-443b-909f-94f346a59199 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:36.212908 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6dbcee19-4286-443b-909f-94f346a59199 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:36.213631 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6dbcee19-4286-443b-909f-94f346a59199 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:36.214632 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6dbcee19-4286-443b-909f-94f346a59199 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:36.216125 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6dbcee19-4286-443b-909f-94f346a59199 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:36.438152 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7c6bc660-9366-42ed-8b2c-23fff9bc26e4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:36.447142 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7c6bc660-9366-42ed-8b2c-23fff9bc26e4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:36.449507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7c6bc660-9366-42ed-8b2c-23fff9bc26e4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:36.450798 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-7c6bc660-9366-42ed-8b2c-23fff9bc26e4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1740 microversion: 2.20 time: 0.265218 Jun 08 02:08:36.451455 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6dbcee19-4286-443b-909f-94f346a59199 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:36.451696 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 203/391] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:08:36 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1740 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:08:36.470531 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6dbcee19-4286-443b-909f-94f346a59199 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1260 microversion: 2.1 time: 0.276086 Jun 08 02:08:36.482755 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 189/392] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:36 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1260 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:08:36.698714 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-25ec9618-7288-4fc0-9b39-3f6691450e90 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9961e04c-e9c3-43be-bd10-e76d0e34c2e4", "device": "/dev/sdb"}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:08:36.701096 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-25ec9618-7288-4fc0-9b39-3f6691450e90 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: dc44145c-7cae-45fa-b339-fd2b3c42e275] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:36.707234 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-25ec9618-7288-4fc0-9b39-3f6691450e90 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:36.707874 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-25ec9618-7288-4fc0-9b39-3f6691450e90 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:36.708818 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-25ec9618-7288-4fc0-9b39-3f6691450e90 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:36.709937 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-25ec9618-7288-4fc0-9b39-3f6691450e90 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:37.046170 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-25ec9618-7288-4fc0-9b39-3f6691450e90 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "POST /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.354309 Jun 08 02:08:37.052533 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 204/393] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jun 8 02:08:36 2022] POST /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275/os-volume_attachments => generated 194 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:08:37.476494 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-66a1e8f1-7598-4c8a-a899-3a31c1d9837f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:37.477059 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-66a1e8f1-7598-4c8a-a899-3a31c1d9837f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:37.489203 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-66a1e8f1-7598-4c8a-a899-3a31c1d9837f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:37.490899 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-66a1e8f1-7598-4c8a-a899-3a31c1d9837f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:37.492357 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-66a1e8f1-7598-4c8a-a899-3a31c1d9837f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:37.492987 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-66a1e8f1-7598-4c8a-a899-3a31c1d9837f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:37.493409 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a1abf7ba-71f7-48f5-87b2-fcefa7382039 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:37.494838 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a1abf7ba-71f7-48f5-87b2-fcefa7382039 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:37.503499 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a1abf7ba-71f7-48f5-87b2-fcefa7382039 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:37.503972 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a1abf7ba-71f7-48f5-87b2-fcefa7382039 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:37.504791 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a1abf7ba-71f7-48f5-87b2-fcefa7382039 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:37.505224 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a1abf7ba-71f7-48f5-87b2-fcefa7382039 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:37.746325 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-66a1e8f1-7598-4c8a-a899-3a31c1d9837f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:37.758760 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-66a1e8f1-7598-4c8a-a899-3a31c1d9837f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:37.761755 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-66a1e8f1-7598-4c8a-a899-3a31c1d9837f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:37.763524 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-66a1e8f1-7598-4c8a-a899-3a31c1d9837f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1740 microversion: 2.20 time: 0.292167 Jun 08 02:08:37.776815 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a1abf7ba-71f7-48f5-87b2-fcefa7382039 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:37.777346 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 190/394] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:08:37 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1740 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 02:08:37.777606 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a1abf7ba-71f7-48f5-87b2-fcefa7382039 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1260 microversion: 2.1 time: 0.291371 Jun 08 02:08:37.787103 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 205/395] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:37 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1260 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:08:38.785571 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-988f481f-3016-4ccd-9ae6-bde8f0aebffc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:38.786544 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-988f481f-3016-4ccd-9ae6-bde8f0aebffc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:38.794662 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-01e69f58-9c1e-422b-9001-b6f471a87cc0 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:38.796127 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-01e69f58-9c1e-422b-9001-b6f471a87cc0 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:38.798787 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=2 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:08:38.799685 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=6 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:08:38.809723 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-988f481f-3016-4ccd-9ae6-bde8f0aebffc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:38.810178 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-988f481f-3016-4ccd-9ae6-bde8f0aebffc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:38.811135 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-988f481f-3016-4ccd-9ae6-bde8f0aebffc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:38.811572 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-988f481f-3016-4ccd-9ae6-bde8f0aebffc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:38.814489 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=100 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:08:38.817121 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-01e69f58-9c1e-422b-9001-b6f471a87cc0 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:38.817805 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-01e69f58-9c1e-422b-9001-b6f471a87cc0 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:38.819334 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-01e69f58-9c1e-422b-9001-b6f471a87cc0 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:38.820027 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-01e69f58-9c1e-422b-9001-b6f471a87cc0 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:38.999945 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:08:39.044659 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-988f481f-3016-4ccd-9ae6-bde8f0aebffc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:39.047999 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-01e69f58-9c1e-422b-9001-b6f471a87cc0 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:39.058492 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-01e69f58-9c1e-422b-9001-b6f471a87cc0 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1260 microversion: 2.1 time: 0.267679 Jun 08 02:08:39.059295 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 206/396] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:38 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1260 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:08:39.070975 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-988f481f-3016-4ccd-9ae6-bde8f0aebffc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:39.072507 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-988f481f-3016-4ccd-9ae6-bde8f0aebffc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:39.073855 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-988f481f-3016-4ccd-9ae6-bde8f0aebffc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1740 microversion: 2.20 time: 0.292636 Jun 08 02:08:39.074888 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 191/397] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:08:38 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1740 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:08:40.075114 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-7428d0c4-bd4b-41d8-842a-0dd36deb5646 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:40.075720 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-7428d0c4-bd4b-41d8-842a-0dd36deb5646 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:40.082863 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7428d0c4-bd4b-41d8-842a-0dd36deb5646 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:40.083310 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7428d0c4-bd4b-41d8-842a-0dd36deb5646 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:40.084654 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7428d0c4-bd4b-41d8-842a-0dd36deb5646 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:40.085096 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7428d0c4-bd4b-41d8-842a-0dd36deb5646 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:40.094812 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9444db5b-0f42-41a1-ab32-507ff1bf7743 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:40.096278 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9444db5b-0f42-41a1-ab32-507ff1bf7743 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:40.103701 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9444db5b-0f42-41a1-ab32-507ff1bf7743 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:40.104149 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9444db5b-0f42-41a1-ab32-507ff1bf7743 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:40.104944 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9444db5b-0f42-41a1-ab32-507ff1bf7743 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:40.105628 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9444db5b-0f42-41a1-ab32-507ff1bf7743 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:40.336095 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9444db5b-0f42-41a1-ab32-507ff1bf7743 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:40.345644 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9444db5b-0f42-41a1-ab32-507ff1bf7743 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:40.353273 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7428d0c4-bd4b-41d8-842a-0dd36deb5646 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:40.360439 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9444db5b-0f42-41a1-ab32-507ff1bf7743 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:40.363025 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-7428d0c4-bd4b-41d8-842a-0dd36deb5646 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1260 microversion: 2.1 time: 0.291653 Jun 08 02:08:40.363782 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 207/398] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:40 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1260 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:08:40.366166 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9444db5b-0f42-41a1-ab32-507ff1bf7743 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1740 microversion: 2.20 time: 0.274776 Jun 08 02:08:40.376832 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 192/399] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:08:40 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1740 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 02:08:41.391399 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-64b7fa5d-a6f3-4b07-9b88-aa320fd4c802 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:41.392918 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-7f516d5d-e554-4006-afc7-26dc4f65d2a8 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:41.394432 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-7f516d5d-e554-4006-afc7-26dc4f65d2a8 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:41.397265 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-64b7fa5d-a6f3-4b07-9b88-aa320fd4c802 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:41.414802 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7f516d5d-e554-4006-afc7-26dc4f65d2a8 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:41.416264 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-64b7fa5d-a6f3-4b07-9b88-aa320fd4c802 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:41.416964 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7f516d5d-e554-4006-afc7-26dc4f65d2a8 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:41.418749 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7f516d5d-e554-4006-afc7-26dc4f65d2a8 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:41.419140 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-64b7fa5d-a6f3-4b07-9b88-aa320fd4c802 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:41.420479 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-64b7fa5d-a6f3-4b07-9b88-aa320fd4c802 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:41.420923 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7f516d5d-e554-4006-afc7-26dc4f65d2a8 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:41.423756 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-64b7fa5d-a6f3-4b07-9b88-aa320fd4c802 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:41.700755 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7f516d5d-e554-4006-afc7-26dc4f65d2a8 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:41.708747 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-7f516d5d-e554-4006-afc7-26dc4f65d2a8 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1260 microversion: 2.1 time: 0.331922 Jun 08 02:08:41.712202 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 208/400] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:41 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1260 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:08:41.716177 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-64b7fa5d-a6f3-4b07-9b88-aa320fd4c802 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:41.727934 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-64b7fa5d-a6f3-4b07-9b88-aa320fd4c802 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:41.730488 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-64b7fa5d-a6f3-4b07-9b88-aa320fd4c802 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:41.731679 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-64b7fa5d-a6f3-4b07-9b88-aa320fd4c802 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1740 microversion: 2.20 time: 0.351233 Jun 08 02:08:41.732592 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 193/401] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:08:41 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1740 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:08:42.726860 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f87ceead-a3dc-43f2-930a-3f137875f22b tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:42.728133 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f87ceead-a3dc-43f2-930a-3f137875f22b tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:42.734681 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f87ceead-a3dc-43f2-930a-3f137875f22b tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:42.735380 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f87ceead-a3dc-43f2-930a-3f137875f22b tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:42.736347 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f87ceead-a3dc-43f2-930a-3f137875f22b tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:42.737021 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f87ceead-a3dc-43f2-930a-3f137875f22b tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:42.752720 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2a1c56c6-4c55-4e05-8d88-62a66dcb429d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:42.755379 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2a1c56c6-4c55-4e05-8d88-62a66dcb429d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:42.763679 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2a1c56c6-4c55-4e05-8d88-62a66dcb429d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:42.764516 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2a1c56c6-4c55-4e05-8d88-62a66dcb429d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:42.765900 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2a1c56c6-4c55-4e05-8d88-62a66dcb429d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:42.767716 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2a1c56c6-4c55-4e05-8d88-62a66dcb429d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:42.965119 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f87ceead-a3dc-43f2-930a-3f137875f22b tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:42.968903 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2a1c56c6-4c55-4e05-8d88-62a66dcb429d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:42.973941 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f87ceead-a3dc-43f2-930a-3f137875f22b tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1260 microversion: 2.1 time: 0.251258 Jun 08 02:08:42.984874 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 209/402] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:42 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1260 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:08:42.992255 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2a1c56c6-4c55-4e05-8d88-62a66dcb429d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:42.993804 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2a1c56c6-4c55-4e05-8d88-62a66dcb429d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:42.994990 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2a1c56c6-4c55-4e05-8d88-62a66dcb429d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1740 microversion: 2.20 time: 0.247939 Jun 08 02:08:42.995553 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 194/403] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:08:42 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1740 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:08:43.556644 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-905ac1a8-bf74-4a56-b0e7-621c245ebceb req-e9b30f6d-4083-4083-bc0d-52fef210c4f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cf1e158-1c3a-488c-8227-d7279cea2978", "name": "network-vif-plugged", "status": "completed", "tag": "8bbb59fb-caf5-486d-bd77-92280696e47b"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:08:43.566361 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-905ac1a8-bf74-4a56-b0e7-621c245ebceb req-e9b30f6d-4083-4083-bc0d-52fef210c4f5 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:43.566949 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-905ac1a8-bf74-4a56-b0e7-621c245ebceb req-e9b30f6d-4083-4083-bc0d-52fef210c4f5 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:43.580684 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-905ac1a8-bf74-4a56-b0e7-621c245ebceb req-e9b30f6d-4083-4083-bc0d-52fef210c4f5 service nova] Creating event network-vif-plugged:8bbb59fb-caf5-486d-bd77-92280696e47b for instance 4cf1e158-1c3a-488c-8227-d7279cea2978 on hv-cinder-84506 Jun 08 02:08:43.587149 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-905ac1a8-bf74-4a56-b0e7-621c245ebceb req-e9b30f6d-4083-4083-bc0d-52fef210c4f5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035935 Jun 08 02:08:43.588254 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 210/404] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:08:43.996958 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-989e675b-1c4e-4333-baa9-1189a1bbb5cd tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:43.998158 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-989e675b-1c4e-4333-baa9-1189a1bbb5cd tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:44.006692 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-989e675b-1c4e-4333-baa9-1189a1bbb5cd tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:44.007134 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-989e675b-1c4e-4333-baa9-1189a1bbb5cd tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:44.012371 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-989e675b-1c4e-4333-baa9-1189a1bbb5cd tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:44.013141 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-989e675b-1c4e-4333-baa9-1189a1bbb5cd tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:44.017424 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-23a1e846-dfa2-481e-b6e7-f6f220c7189d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:44.019129 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-23a1e846-dfa2-481e-b6e7-f6f220c7189d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:44.031624 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-23a1e846-dfa2-481e-b6e7-f6f220c7189d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:44.032845 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-23a1e846-dfa2-481e-b6e7-f6f220c7189d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:44.036432 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-23a1e846-dfa2-481e-b6e7-f6f220c7189d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:44.037463 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-23a1e846-dfa2-481e-b6e7-f6f220c7189d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:44.258331 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-989e675b-1c4e-4333-baa9-1189a1bbb5cd tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:44.265821 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-23a1e846-dfa2-481e-b6e7-f6f220c7189d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:44.268369 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-989e675b-1c4e-4333-baa9-1189a1bbb5cd tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1260 microversion: 2.1 time: 0.275936 Jun 08 02:08:44.269428 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 195/405] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:43 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1260 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:08:44.275016 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-23a1e846-dfa2-481e-b6e7-f6f220c7189d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:44.276768 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-23a1e846-dfa2-481e-b6e7-f6f220c7189d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:44.278245 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-23a1e846-dfa2-481e-b6e7-f6f220c7189d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1740 microversion: 2.20 time: 0.268034 Jun 08 02:08:44.279057 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 211/406] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:08:44 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1740 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:08:45.285435 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8ba581d8-3820-4a0f-9c83-6ee9af22d360 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:45.286034 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8ba581d8-3820-4a0f-9c83-6ee9af22d360 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:45.292592 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8ba581d8-3820-4a0f-9c83-6ee9af22d360 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:45.293030 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8ba581d8-3820-4a0f-9c83-6ee9af22d360 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:45.293774 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8ba581d8-3820-4a0f-9c83-6ee9af22d360 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:45.294198 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8ba581d8-3820-4a0f-9c83-6ee9af22d360 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:45.297060 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d35c615d-f45f-412d-9e7c-1086aa83c1a0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:45.297698 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d35c615d-f45f-412d-9e7c-1086aa83c1a0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:45.304764 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d35c615d-f45f-412d-9e7c-1086aa83c1a0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:45.305208 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d35c615d-f45f-412d-9e7c-1086aa83c1a0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:45.305964 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d35c615d-f45f-412d-9e7c-1086aa83c1a0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:45.306397 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d35c615d-f45f-412d-9e7c-1086aa83c1a0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:45.492694 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8ba581d8-3820-4a0f-9c83-6ee9af22d360 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:45.495782 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d35c615d-f45f-412d-9e7c-1086aa83c1a0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:45.500167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8ba581d8-3820-4a0f-9c83-6ee9af22d360 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1260 microversion: 2.1 time: 0.218795 Jun 08 02:08:45.500867 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 196/407] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:45 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1260 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:08:45.503949 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d35c615d-f45f-412d-9e7c-1086aa83c1a0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:45.506473 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d35c615d-f45f-412d-9e7c-1086aa83c1a0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:45.507609 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d35c615d-f45f-412d-9e7c-1086aa83c1a0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1740 microversion: 2.20 time: 0.214319 Jun 08 02:08:45.508142 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 212/408] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:08:45 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1740 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 02:08:46.517458 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d64b9eae-0ad0-4ec8-a296-3ef0487b12b3 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:46.518060 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d64b9eae-0ad0-4ec8-a296-3ef0487b12b3 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:46.525299 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d64b9eae-0ad0-4ec8-a296-3ef0487b12b3 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:46.525739 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d64b9eae-0ad0-4ec8-a296-3ef0487b12b3 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:46.526078 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-94fd9748-a82b-4dd3-bc2b-97adc9a0e7ef tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:46.526521 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d64b9eae-0ad0-4ec8-a296-3ef0487b12b3 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:46.526692 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-94fd9748-a82b-4dd3-bc2b-97adc9a0e7ef tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:46.526893 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d64b9eae-0ad0-4ec8-a296-3ef0487b12b3 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:46.533030 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-94fd9748-a82b-4dd3-bc2b-97adc9a0e7ef tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:46.533731 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-94fd9748-a82b-4dd3-bc2b-97adc9a0e7ef tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:46.534483 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-94fd9748-a82b-4dd3-bc2b-97adc9a0e7ef tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:46.534916 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-94fd9748-a82b-4dd3-bc2b-97adc9a0e7ef tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:46.712420 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d64b9eae-0ad0-4ec8-a296-3ef0487b12b3 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:46.719874 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d64b9eae-0ad0-4ec8-a296-3ef0487b12b3 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1260 microversion: 2.1 time: 0.206177 Jun 08 02:08:46.720444 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 197/409] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:46 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1260 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:08:46.724413 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-94fd9748-a82b-4dd3-bc2b-97adc9a0e7ef tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:46.733051 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-94fd9748-a82b-4dd3-bc2b-97adc9a0e7ef tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:46.734539 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-94fd9748-a82b-4dd3-bc2b-97adc9a0e7ef tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:46.735663 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-94fd9748-a82b-4dd3-bc2b-97adc9a0e7ef tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1740 microversion: 2.20 time: 0.213399 Jun 08 02:08:46.736199 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 213/410] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:08:46 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1740 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 02:08:47.737272 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-648e0edd-10c3-4308-a91e-a202dbe7c109 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:47.737797 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-648e0edd-10c3-4308-a91e-a202dbe7c109 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:47.745448 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-648e0edd-10c3-4308-a91e-a202dbe7c109 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:47.746030 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-648e0edd-10c3-4308-a91e-a202dbe7c109 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:47.746827 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-648e0edd-10c3-4308-a91e-a202dbe7c109 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:47.747714 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-648e0edd-10c3-4308-a91e-a202dbe7c109 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:47.754236 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-fea66409-5cc1-450b-af1f-94d157f364e3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:47.754833 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-fea66409-5cc1-450b-af1f-94d157f364e3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:47.761838 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fea66409-5cc1-450b-af1f-94d157f364e3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:47.762284 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fea66409-5cc1-450b-af1f-94d157f364e3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:47.763035 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fea66409-5cc1-450b-af1f-94d157f364e3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:47.763461 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fea66409-5cc1-450b-af1f-94d157f364e3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:47.945963 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-648e0edd-10c3-4308-a91e-a202dbe7c109 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:47.952545 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-fea66409-5cc1-450b-af1f-94d157f364e3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:47.953630 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-648e0edd-10c3-4308-a91e-a202dbe7c109 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1260 microversion: 2.1 time: 0.220203 Jun 08 02:08:47.954197 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 198/411] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:47 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1260 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:08:47.960275 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-fea66409-5cc1-450b-af1f-94d157f364e3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:47.961791 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-fea66409-5cc1-450b-af1f-94d157f364e3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:47.962923 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-fea66409-5cc1-450b-af1f-94d157f364e3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1740 microversion: 2.20 time: 0.212544 Jun 08 02:08:47.963473 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 214/412] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:08:47 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1740 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 02:08:48.971233 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-273287ef-6353-423b-8ce5-b0de96499d60 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:48.972086 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-273287ef-6353-423b-8ce5-b0de96499d60 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:48.980060 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-273287ef-6353-423b-8ce5-b0de96499d60 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:48.980547 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-273287ef-6353-423b-8ce5-b0de96499d60 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:48.981328 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-273287ef-6353-423b-8ce5-b0de96499d60 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:48.981534 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d45b2d94-3ad6-4c71-8b36-6e4f77014e0b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:48.982020 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-273287ef-6353-423b-8ce5-b0de96499d60 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:48.982139 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d45b2d94-3ad6-4c71-8b36-6e4f77014e0b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:48.989271 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d45b2d94-3ad6-4c71-8b36-6e4f77014e0b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:48.989720 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d45b2d94-3ad6-4c71-8b36-6e4f77014e0b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:48.991216 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d45b2d94-3ad6-4c71-8b36-6e4f77014e0b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:48.991979 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d45b2d94-3ad6-4c71-8b36-6e4f77014e0b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:49.018746 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:08:49.296323 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-273287ef-6353-423b-8ce5-b0de96499d60 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:49.304793 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-273287ef-6353-423b-8ce5-b0de96499d60 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1444 microversion: 2.1 time: 0.338177 Jun 08 02:08:49.315955 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 199/413] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:48 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1444 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:08:49.316153 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d45b2d94-3ad6-4c71-8b36-6e4f77014e0b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:49.317280 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d45b2d94-3ad6-4c71-8b36-6e4f77014e0b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:49.319349 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d45b2d94-3ad6-4c71-8b36-6e4f77014e0b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:49.320604 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d45b2d94-3ad6-4c71-8b36-6e4f77014e0b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1722 microversion: 2.20 time: 0.343924 Jun 08 02:08:49.321326 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 215/414] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:08:48 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1722 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:08:49.322818 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e819a60f-8fb1-4ac1-b83f-ea84e2fff3dc tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:49.323564 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e819a60f-8fb1-4ac1-b83f-ea84e2fff3dc tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:49.330190 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e819a60f-8fb1-4ac1-b83f-ea84e2fff3dc tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:49.331007 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e819a60f-8fb1-4ac1-b83f-ea84e2fff3dc tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:49.331855 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e819a60f-8fb1-4ac1-b83f-ea84e2fff3dc tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:49.332376 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e819a60f-8fb1-4ac1-b83f-ea84e2fff3dc tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:49.525179 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e819a60f-8fb1-4ac1-b83f-ea84e2fff3dc tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:49.532549 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e819a60f-8fb1-4ac1-b83f-ea84e2fff3dc tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1444 microversion: 2.1 time: 0.215205 Jun 08 02:08:49.533105 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 200/415] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:08:49 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1444 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:08:50.339657 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-94e37d7c-1feb-45c9-8267-c6175d5d5a8d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:50.340289 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-94e37d7c-1feb-45c9-8267-c6175d5d5a8d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:50.346761 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-94e37d7c-1feb-45c9-8267-c6175d5d5a8d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:50.347216 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-94e37d7c-1feb-45c9-8267-c6175d5d5a8d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:50.348008 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-94e37d7c-1feb-45c9-8267-c6175d5d5a8d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:50.348469 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-94e37d7c-1feb-45c9-8267-c6175d5d5a8d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:50.799278 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-94e37d7c-1feb-45c9-8267-c6175d5d5a8d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:50.808164 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-94e37d7c-1feb-45c9-8267-c6175d5d5a8d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:50.809705 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-94e37d7c-1feb-45c9-8267-c6175d5d5a8d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:50.810832 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-94e37d7c-1feb-45c9-8267-c6175d5d5a8d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1722 microversion: 2.20 time: 0.475160 Jun 08 02:08:50.811378 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 216/416] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:08:50 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1722 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:08:51.563667 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-3f0055b5-8afa-436f-bdc9-0c4da32d23a5 req-e93c6bef-1659-4d97-8fe3-d309c39971a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cf1e158-1c3a-488c-8227-d7279cea2978", "tag": "8bbb59fb-caf5-486d-bd77-92280696e47b"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:08:51.573457 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-3f0055b5-8afa-436f-bdc9-0c4da32d23a5 req-e93c6bef-1659-4d97-8fe3-d309c39971a3 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:51.574143 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-3f0055b5-8afa-436f-bdc9-0c4da32d23a5 req-e93c6bef-1659-4d97-8fe3-d309c39971a3 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:51.586848 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-3f0055b5-8afa-436f-bdc9-0c4da32d23a5 req-e93c6bef-1659-4d97-8fe3-d309c39971a3 service nova] Creating event network-changed:8bbb59fb-caf5-486d-bd77-92280696e47b for instance 4cf1e158-1c3a-488c-8227-d7279cea2978 on hv-cinder-84506 Jun 08 02:08:51.591924 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-3f0055b5-8afa-436f-bdc9-0c4da32d23a5 req-e93c6bef-1659-4d97-8fe3-d309c39971a3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032276 Jun 08 02:08:51.592649 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 201/417] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:08:51.828991 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2c62bad4-6686-4025-8631-65681bc29be9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:51.829594 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-2c62bad4-6686-4025-8631-65681bc29be9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:51.831863 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:08:51.837899 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2c62bad4-6686-4025-8631-65681bc29be9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:51.838346 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2c62bad4-6686-4025-8631-65681bc29be9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:51.839112 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2c62bad4-6686-4025-8631-65681bc29be9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:51.839544 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2c62bad4-6686-4025-8631-65681bc29be9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:51.977860 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2c62bad4-6686-4025-8631-65681bc29be9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:51.986623 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2c62bad4-6686-4025-8631-65681bc29be9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:51.988118 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2c62bad4-6686-4025-8631-65681bc29be9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:51.989278 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2c62bad4-6686-4025-8631-65681bc29be9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1722 microversion: 2.20 time: 0.164152 Jun 08 02:08:51.989969 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 217/418] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:08:51 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:08:52.482048 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-3c0c1e79-b6d6-4ecb-95c6-547fbeeb20a9 req-50463769-42b3-4bc8-97c0-092525060403 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7944f2e-2294-4a69-bd4e-d51f50e73e56", "name": "network-vif-unplugged", "status": "completed", "tag": "4c178719-6047-43d9-9d57-30618b0b060e"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:08:52.492746 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-3c0c1e79-b6d6-4ecb-95c6-547fbeeb20a9 req-50463769-42b3-4bc8-97c0-092525060403 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:52.493196 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-3c0c1e79-b6d6-4ecb-95c6-547fbeeb20a9 req-50463769-42b3-4bc8-97c0-092525060403 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:52.508955 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-3c0c1e79-b6d6-4ecb-95c6-547fbeeb20a9 req-50463769-42b3-4bc8-97c0-092525060403 service nova] Creating event network-vif-unplugged:4c178719-6047-43d9-9d57-30618b0b060e for instance b7944f2e-2294-4a69-bd4e-d51f50e73e56 on hv-cinder-84506 Jun 08 02:08:52.511795 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-3c0c1e79-b6d6-4ecb-95c6-547fbeeb20a9 req-50463769-42b3-4bc8-97c0-092525060403 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036437 Jun 08 02:08:52.512434 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 202/419] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:08:53.007234 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e72b5e49-eab8-427a-9e02-6ab32a929a07 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:53.008002 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e72b5e49-eab8-427a-9e02-6ab32a929a07 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:53.014620 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e72b5e49-eab8-427a-9e02-6ab32a929a07 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:53.015088 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e72b5e49-eab8-427a-9e02-6ab32a929a07 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:53.016420 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e72b5e49-eab8-427a-9e02-6ab32a929a07 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:53.017161 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e72b5e49-eab8-427a-9e02-6ab32a929a07 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:53.156026 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e72b5e49-eab8-427a-9e02-6ab32a929a07 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:53.164689 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e72b5e49-eab8-427a-9e02-6ab32a929a07 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:53.166216 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e72b5e49-eab8-427a-9e02-6ab32a929a07 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:53.167343 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e72b5e49-eab8-427a-9e02-6ab32a929a07 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1722 microversion: 2.20 time: 0.164137 Jun 08 02:08:53.167889 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 218/420] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:08:53 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:08:54.187404 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9a59e4d8-9ff3-43f1-aa9c-0f949ebb277d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:54.188008 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9a59e4d8-9ff3-43f1-aa9c-0f949ebb277d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:54.189985 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=52 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:08:54.196182 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9a59e4d8-9ff3-43f1-aa9c-0f949ebb277d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:54.196661 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9a59e4d8-9ff3-43f1-aa9c-0f949ebb277d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:54.197419 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9a59e4d8-9ff3-43f1-aa9c-0f949ebb277d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:54.197852 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9a59e4d8-9ff3-43f1-aa9c-0f949ebb277d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:54.336042 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9a59e4d8-9ff3-43f1-aa9c-0f949ebb277d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:54.343891 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9a59e4d8-9ff3-43f1-aa9c-0f949ebb277d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:54.345426 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9a59e4d8-9ff3-43f1-aa9c-0f949ebb277d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:54.346558 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9a59e4d8-9ff3-43f1-aa9c-0f949ebb277d tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1722 microversion: 2.20 time: 0.164028 Jun 08 02:08:54.347105 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 203/421] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:08:54 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:08:55.364879 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-7c9d3695-f915-417e-b7b7-b44c53676c75 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:55.366099 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-7c9d3695-f915-417e-b7b7-b44c53676c75 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:55.373135 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7c9d3695-f915-417e-b7b7-b44c53676c75 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:55.373576 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7c9d3695-f915-417e-b7b7-b44c53676c75 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:55.374350 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7c9d3695-f915-417e-b7b7-b44c53676c75 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:55.374777 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7c9d3695-f915-417e-b7b7-b44c53676c75 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:55.504789 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7c9d3695-f915-417e-b7b7-b44c53676c75 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:55.513953 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7c9d3695-f915-417e-b7b7-b44c53676c75 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:55.515475 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7c9d3695-f915-417e-b7b7-b44c53676c75 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:55.516657 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-7c9d3695-f915-417e-b7b7-b44c53676c75 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1722 microversion: 2.20 time: 0.155560 Jun 08 02:08:55.520456 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 219/422] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:08:55 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:08:56.534726 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a3301a51-6e43-464e-9147-769d1e9e65cc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:56.535335 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a3301a51-6e43-464e-9147-769d1e9e65cc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:56.542108 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a3301a51-6e43-464e-9147-769d1e9e65cc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:56.542561 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a3301a51-6e43-464e-9147-769d1e9e65cc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:56.543330 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a3301a51-6e43-464e-9147-769d1e9e65cc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:56.543770 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a3301a51-6e43-464e-9147-769d1e9e65cc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:56.774596 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a3301a51-6e43-464e-9147-769d1e9e65cc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:56.782929 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a3301a51-6e43-464e-9147-769d1e9e65cc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:56.784948 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a3301a51-6e43-464e-9147-769d1e9e65cc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:56.786155 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a3301a51-6e43-464e-9147-769d1e9e65cc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1722 microversion: 2.20 time: 0.255569 Jun 08 02:08:56.787428 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 204/423] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:08:56 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:08:57.805728 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-fcc04f3e-d1b4-4ade-bb61-832453135f8f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:57.806333 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-fcc04f3e-d1b4-4ade-bb61-832453135f8f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:57.812797 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fcc04f3e-d1b4-4ade-bb61-832453135f8f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:57.813240 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fcc04f3e-d1b4-4ade-bb61-832453135f8f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:57.814004 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fcc04f3e-d1b4-4ade-bb61-832453135f8f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:57.814518 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fcc04f3e-d1b4-4ade-bb61-832453135f8f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:57.946999 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-fcc04f3e-d1b4-4ade-bb61-832453135f8f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:57.954973 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-fcc04f3e-d1b4-4ade-bb61-832453135f8f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:57.956521 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-fcc04f3e-d1b4-4ade-bb61-832453135f8f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:57.957684 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-fcc04f3e-d1b4-4ade-bb61-832453135f8f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1665 microversion: 2.20 time: 0.156590 Jun 08 02:08:57.958232 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 220/424] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:08:57 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1665 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:08:57.975436 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-44684669-307e-4ed4-a06b-f71dd6792567 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c47ed588-2d09-496b-91e6-c5803d3cc250"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:08:57.976581 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-44684669-307e-4ed4-a06b-f71dd6792567 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:57.983091 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-44684669-307e-4ed4-a06b-f71dd6792567 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:57.983544 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-44684669-307e-4ed4-a06b-f71dd6792567 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:57.984302 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-44684669-307e-4ed4-a06b-f71dd6792567 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:57.984765 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-44684669-307e-4ed4-a06b-f71dd6792567 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:58.252601 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-44684669-307e-4ed4-a06b-f71dd6792567 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "POST /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.281182 Jun 08 02:08:58.253202 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 205/425] 10.222.0.20 () {62 vars in 1363 bytes} [Wed Jun 8 02:08:57 2022] POST /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56/os-volume_attachments => generated 188 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 08 02:08:58.368260 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-525ebfb2-6d9c-4cde-9056-b1b95038752f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:08:58.368893 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-525ebfb2-6d9c-4cde-9056-b1b95038752f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:58.374863 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-525ebfb2-6d9c-4cde-9056-b1b95038752f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:58.375306 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-525ebfb2-6d9c-4cde-9056-b1b95038752f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:58.376058 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-525ebfb2-6d9c-4cde-9056-b1b95038752f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:58.376533 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-525ebfb2-6d9c-4cde-9056-b1b95038752f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:58.466974 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-525ebfb2-6d9c-4cde-9056-b1b95038752f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "POST /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56/action" status: 202 len: 0 microversion: 2.20 time: 0.102467 Jun 08 02:08:58.467924 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 221/426] 10.222.0.20 () {62 vars in 1318 bytes} [Wed Jun 8 02:08:58 2022] POST /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 08 02:08:58.476096 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cf77c011-845a-464d-a98a-5b90b94fe644 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:58.476722 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-cf77c011-845a-464d-a98a-5b90b94fe644 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:58.483487 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cf77c011-845a-464d-a98a-5b90b94fe644 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:58.483929 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cf77c011-845a-464d-a98a-5b90b94fe644 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:58.484864 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cf77c011-845a-464d-a98a-5b90b94fe644 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:58.485212 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cf77c011-845a-464d-a98a-5b90b94fe644 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:58.500863 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:08:58.625962 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-cf77c011-845a-464d-a98a-5b90b94fe644 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:58.634817 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-cf77c011-845a-464d-a98a-5b90b94fe644 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:58.636320 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-cf77c011-845a-464d-a98a-5b90b94fe644 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:58.637650 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-cf77c011-845a-464d-a98a-5b90b94fe644 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1751 microversion: 2.20 time: 0.165895 Jun 08 02:08:58.638358 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 206/427] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:08:58 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:08:59.655963 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-550f9d33-865e-4325-a508-fc7bb1837efe tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:08:59.656720 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-550f9d33-865e-4325-a508-fc7bb1837efe tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:08:59.664317 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-550f9d33-865e-4325-a508-fc7bb1837efe tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:59.664793 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-550f9d33-865e-4325-a508-fc7bb1837efe tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:59.665573 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-550f9d33-865e-4325-a508-fc7bb1837efe tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:08:59.666003 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-550f9d33-865e-4325-a508-fc7bb1837efe tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:08:59.798843 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-550f9d33-865e-4325-a508-fc7bb1837efe tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:59.807557 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-550f9d33-865e-4325-a508-fc7bb1837efe tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:59.809095 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-550f9d33-865e-4325-a508-fc7bb1837efe tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:08:59.810242 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-550f9d33-865e-4325-a508-fc7bb1837efe tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1753 microversion: 2.20 time: 0.158207 Jun 08 02:08:59.810785 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 222/428] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:08:59 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:09:00.829550 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9953fb94-af2f-4a07-85d1-01d3bba3a9d9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:00.830147 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9953fb94-af2f-4a07-85d1-01d3bba3a9d9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:00.837401 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9953fb94-af2f-4a07-85d1-01d3bba3a9d9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:00.837851 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9953fb94-af2f-4a07-85d1-01d3bba3a9d9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:00.838669 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9953fb94-af2f-4a07-85d1-01d3bba3a9d9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:00.839101 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9953fb94-af2f-4a07-85d1-01d3bba3a9d9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:00.901919 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-13680f85-cb6c-42ff-8e1c-7f298dafee80 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:00.902403 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-13680f85-cb6c-42ff-8e1c-7f298dafee80 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: dc44145c-7cae-45fa-b339-fd2b3c42e275] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:00.909256 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-13680f85-cb6c-42ff-8e1c-7f298dafee80 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:00.909704 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-13680f85-cb6c-42ff-8e1c-7f298dafee80 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:00.910458 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-13680f85-cb6c-42ff-8e1c-7f298dafee80 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:00.910884 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-13680f85-cb6c-42ff-8e1c-7f298dafee80 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:01.036409 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9953fb94-af2f-4a07-85d1-01d3bba3a9d9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:01.041972 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.objects.instance [None req-13680f85-cb6c-42ff-8e1c-7f298dafee80 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lazy-loading 'services' on Instance uuid dc44145c-7cae-45fa-b339-fd2b3c42e275 {{(pid=117939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 02:09:01.045943 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9953fb94-af2f-4a07-85d1-01d3bba3a9d9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:01.047663 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9953fb94-af2f-4a07-85d1-01d3bba3a9d9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:01.048858 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9953fb94-af2f-4a07-85d1-01d3bba3a9d9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1809 microversion: 2.20 time: 0.223145 Jun 08 02:09:01.055604 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 207/429] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:09:00 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1809 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:09:01.157799 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-13680f85-cb6c-42ff-8e1c-7f298dafee80 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275/os-volume_attachments/9961e04c-e9c3-43be-bd10-e76d0e34c2e4" status: 202 len: 0 microversion: 2.1 time: 0.260460 Jun 08 02:09:01.158835 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 223/430] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jun 8 02:09:00 2022] DELETE /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275/os-volume_attachments/9961e04c-e9c3-43be-bd10-e76d0e34c2e4 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 08 02:09:02.067304 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4a4eaae8-9634-4fb8-b63f-458442dedccc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:02.067858 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4a4eaae8-9634-4fb8-b63f-458442dedccc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:02.079213 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4a4eaae8-9634-4fb8-b63f-458442dedccc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:02.079658 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4a4eaae8-9634-4fb8-b63f-458442dedccc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:02.080485 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4a4eaae8-9634-4fb8-b63f-458442dedccc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:02.080930 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4a4eaae8-9634-4fb8-b63f-458442dedccc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:02.255785 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4a4eaae8-9634-4fb8-b63f-458442dedccc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:02.265706 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4a4eaae8-9634-4fb8-b63f-458442dedccc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:02.267208 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4a4eaae8-9634-4fb8-b63f-458442dedccc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:02.268375 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4a4eaae8-9634-4fb8-b63f-458442dedccc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1809 microversion: 2.20 time: 0.204990 Jun 08 02:09:02.268950 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 208/431] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:09:02 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1809 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:09:02.292936 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-3736ba0c-3968-469f-9730-f3aaa0b7d874 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:02.293746 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-3736ba0c-3968-469f-9730-f3aaa0b7d874 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: dc44145c-7cae-45fa-b339-fd2b3c42e275] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:02.300779 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3736ba0c-3968-469f-9730-f3aaa0b7d874 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:02.301306 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3736ba0c-3968-469f-9730-f3aaa0b7d874 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:02.302744 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3736ba0c-3968-469f-9730-f3aaa0b7d874 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:02.303243 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3736ba0c-3968-469f-9730-f3aaa0b7d874 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:02.336584 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-3736ba0c-3968-469f-9730-f3aaa0b7d874 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: dc44145c-7cae-45fa-b339-fd2b3c42e275] Going to try to terminate instance {{(pid=117939) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 02:09:02.438595 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-3736ba0c-3968-469f-9730-f3aaa0b7d874 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275" status: 204 len: 0 microversion: 2.1 time: 0.149611 Jun 08 02:09:02.439206 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 224/432] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jun 8 02:09:02 2022] DELETE /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 08 02:09:02.450790 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3d574afd-caed-4bf3-84d3-ec32d8bb8825 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:02.451435 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3d574afd-caed-4bf3-84d3-ec32d8bb8825 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: dc44145c-7cae-45fa-b339-fd2b3c42e275] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:02.457387 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3d574afd-caed-4bf3-84d3-ec32d8bb8825 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:02.457834 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3d574afd-caed-4bf3-84d3-ec32d8bb8825 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:02.458613 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3d574afd-caed-4bf3-84d3-ec32d8bb8825 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:02.459045 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3d574afd-caed-4bf3-84d3-ec32d8bb8825 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:02.589097 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3d574afd-caed-4bf3-84d3-ec32d8bb8825 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:02.598414 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3d574afd-caed-4bf3-84d3-ec32d8bb8825 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275" status: 200 len: 1560 microversion: 2.1 time: 0.153670 Jun 08 02:09:02.599058 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 209/433] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:02 2022] GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:03.288802 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-bf1e7735-756a-4613-bee4-c1615efdc88e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:03.289598 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-bf1e7735-756a-4613-bee4-c1615efdc88e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:03.295782 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bf1e7735-756a-4613-bee4-c1615efdc88e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:03.296500 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bf1e7735-756a-4613-bee4-c1615efdc88e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:03.297116 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bf1e7735-756a-4613-bee4-c1615efdc88e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:03.297629 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bf1e7735-756a-4613-bee4-c1615efdc88e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:03.437566 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-bf1e7735-756a-4613-bee4-c1615efdc88e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:03.446483 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-bf1e7735-756a-4613-bee4-c1615efdc88e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:03.448000 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-bf1e7735-756a-4613-bee4-c1615efdc88e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:03.449188 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-bf1e7735-756a-4613-bee4-c1615efdc88e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1809 microversion: 2.20 time: 0.165792 Jun 08 02:09:03.460566 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 225/434] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:09:03 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:09:03.615156 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-990bfb0d-8835-42d4-8e13-9339df7bff3b tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:03.615863 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-990bfb0d-8835-42d4-8e13-9339df7bff3b tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: dc44145c-7cae-45fa-b339-fd2b3c42e275] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:03.622666 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-990bfb0d-8835-42d4-8e13-9339df7bff3b tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:03.623112 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-990bfb0d-8835-42d4-8e13-9339df7bff3b tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:03.623879 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-990bfb0d-8835-42d4-8e13-9339df7bff3b tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:03.624311 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-990bfb0d-8835-42d4-8e13-9339df7bff3b tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:03.759612 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-990bfb0d-8835-42d4-8e13-9339df7bff3b tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:03.767766 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-990bfb0d-8835-42d4-8e13-9339df7bff3b tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275" status: 200 len: 1560 microversion: 2.1 time: 0.156499 Jun 08 02:09:03.768337 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 210/435] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:03 2022] GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:04.467805 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f79c2796-5f6c-4d39-8226-179bb335d7e4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:04.468430 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f79c2796-5f6c-4d39-8226-179bb335d7e4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:04.474979 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f79c2796-5f6c-4d39-8226-179bb335d7e4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:04.476019 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f79c2796-5f6c-4d39-8226-179bb335d7e4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:04.476815 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f79c2796-5f6c-4d39-8226-179bb335d7e4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:04.477264 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f79c2796-5f6c-4d39-8226-179bb335d7e4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:04.613760 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f79c2796-5f6c-4d39-8226-179bb335d7e4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:04.623111 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f79c2796-5f6c-4d39-8226-179bb335d7e4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:04.624766 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f79c2796-5f6c-4d39-8226-179bb335d7e4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:04.625909 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f79c2796-5f6c-4d39-8226-179bb335d7e4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1809 microversion: 2.20 time: 0.161968 Jun 08 02:09:04.626453 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 226/436] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:09:04 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:09:04.785873 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b54b8748-54db-487a-8112-58d3de020201 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:04.787111 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b54b8748-54db-487a-8112-58d3de020201 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: dc44145c-7cae-45fa-b339-fd2b3c42e275] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:04.794756 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b54b8748-54db-487a-8112-58d3de020201 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:04.795205 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b54b8748-54db-487a-8112-58d3de020201 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:04.795977 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b54b8748-54db-487a-8112-58d3de020201 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:04.796442 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b54b8748-54db-487a-8112-58d3de020201 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:04.933413 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b54b8748-54db-487a-8112-58d3de020201 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:04.942790 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b54b8748-54db-487a-8112-58d3de020201 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275" status: 200 len: 1560 microversion: 2.1 time: 0.160949 Jun 08 02:09:04.943340 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 211/437] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:04 2022] GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:09:05.644562 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d1d62d44-35fa-4145-94bb-61820d28ce87 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:05.645189 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d1d62d44-35fa-4145-94bb-61820d28ce87 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:05.652908 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d1d62d44-35fa-4145-94bb-61820d28ce87 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:05.653356 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d1d62d44-35fa-4145-94bb-61820d28ce87 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:05.654101 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d1d62d44-35fa-4145-94bb-61820d28ce87 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:05.654550 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d1d62d44-35fa-4145-94bb-61820d28ce87 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:05.793774 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d1d62d44-35fa-4145-94bb-61820d28ce87 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:05.802279 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d1d62d44-35fa-4145-94bb-61820d28ce87 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:05.803824 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d1d62d44-35fa-4145-94bb-61820d28ce87 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:05.805008 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d1d62d44-35fa-4145-94bb-61820d28ce87 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1809 microversion: 2.20 time: 0.164438 Jun 08 02:09:05.805708 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 227/438] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:09:05 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:09:05.961306 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ecaeeb16-94f2-49d8-ae0e-b47bee45c1ea tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:05.961906 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ecaeeb16-94f2-49d8-ae0e-b47bee45c1ea tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: dc44145c-7cae-45fa-b339-fd2b3c42e275] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:05.968523 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ecaeeb16-94f2-49d8-ae0e-b47bee45c1ea tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:05.968970 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ecaeeb16-94f2-49d8-ae0e-b47bee45c1ea tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:05.969740 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ecaeeb16-94f2-49d8-ae0e-b47bee45c1ea tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:05.970174 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ecaeeb16-94f2-49d8-ae0e-b47bee45c1ea tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:06.107246 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ecaeeb16-94f2-49d8-ae0e-b47bee45c1ea tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:06.115544 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ecaeeb16-94f2-49d8-ae0e-b47bee45c1ea tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275" status: 200 len: 1560 microversion: 2.1 time: 0.158779 Jun 08 02:09:06.116809 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 212/439] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:05 2022] GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:06.823117 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-7770ebf4-31ed-4cd3-98a8-73394fb7b15f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:06.823715 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-7770ebf4-31ed-4cd3-98a8-73394fb7b15f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:06.830427 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7770ebf4-31ed-4cd3-98a8-73394fb7b15f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:06.830944 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7770ebf4-31ed-4cd3-98a8-73394fb7b15f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:06.831817 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7770ebf4-31ed-4cd3-98a8-73394fb7b15f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:06.832554 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7770ebf4-31ed-4cd3-98a8-73394fb7b15f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:06.977963 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7770ebf4-31ed-4cd3-98a8-73394fb7b15f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:06.981239 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:09:06.990064 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7770ebf4-31ed-4cd3-98a8-73394fb7b15f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:06.991678 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7770ebf4-31ed-4cd3-98a8-73394fb7b15f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:06.992915 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-7770ebf4-31ed-4cd3-98a8-73394fb7b15f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1809 microversion: 2.20 time: 0.173763 Jun 08 02:09:06.993493 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 228/440] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:09:06 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:09:07.134241 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-54be89ee-eb31-4891-9dde-353b41eb9feb tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:07.135412 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-54be89ee-eb31-4891-9dde-353b41eb9feb tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: dc44145c-7cae-45fa-b339-fd2b3c42e275] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:07.142350 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-54be89ee-eb31-4891-9dde-353b41eb9feb tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:07.142789 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-54be89ee-eb31-4891-9dde-353b41eb9feb tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:07.143549 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-54be89ee-eb31-4891-9dde-353b41eb9feb tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:07.144165 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-54be89ee-eb31-4891-9dde-353b41eb9feb tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:07.283816 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-54be89ee-eb31-4891-9dde-353b41eb9feb tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:07.292976 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-54be89ee-eb31-4891-9dde-353b41eb9feb tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275" status: 200 len: 1560 microversion: 2.1 time: 0.163301 Jun 08 02:09:07.293812 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 213/441] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:07 2022] GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:08.011767 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-241a30c1-408d-44e3-bc8c-bae7b7ce2afd tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:08.012507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-241a30c1-408d-44e3-bc8c-bae7b7ce2afd tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:08.019763 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-241a30c1-408d-44e3-bc8c-bae7b7ce2afd tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:08.020220 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-241a30c1-408d-44e3-bc8c-bae7b7ce2afd tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:08.021014 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-241a30c1-408d-44e3-bc8c-bae7b7ce2afd tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:08.021442 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-241a30c1-408d-44e3-bc8c-bae7b7ce2afd tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:08.155462 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-241a30c1-408d-44e3-bc8c-bae7b7ce2afd tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:08.165824 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-241a30c1-408d-44e3-bc8c-bae7b7ce2afd tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:08.167278 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-241a30c1-408d-44e3-bc8c-bae7b7ce2afd tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:08.168482 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-241a30c1-408d-44e3-bc8c-bae7b7ce2afd tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1809 microversion: 2.20 time: 0.161173 Jun 08 02:09:08.169039 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 229/442] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:09:08 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:09:08.315581 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-675ea95b-f7a3-4454-85cc-27bd21be42a3 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:08.316174 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-675ea95b-f7a3-4454-85cc-27bd21be42a3 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: dc44145c-7cae-45fa-b339-fd2b3c42e275] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:08.323640 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-675ea95b-f7a3-4454-85cc-27bd21be42a3 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:08.324095 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-675ea95b-f7a3-4454-85cc-27bd21be42a3 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:08.324895 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-675ea95b-f7a3-4454-85cc-27bd21be42a3 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:08.325336 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-675ea95b-f7a3-4454-85cc-27bd21be42a3 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:08.467064 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-675ea95b-f7a3-4454-85cc-27bd21be42a3 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:08.477019 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-675ea95b-f7a3-4454-85cc-27bd21be42a3 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275" status: 200 len: 1560 microversion: 2.1 time: 0.165252 Jun 08 02:09:08.486947 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 214/443] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:08 2022] GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:09.187132 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-7fb34298-1fce-4250-969f-ee1c24bb0465 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:09.187692 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-7fb34298-1fce-4250-969f-ee1c24bb0465 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:09.195811 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7fb34298-1fce-4250-969f-ee1c24bb0465 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:09.196258 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7fb34298-1fce-4250-969f-ee1c24bb0465 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:09.197193 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7fb34298-1fce-4250-969f-ee1c24bb0465 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:09.197629 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7fb34298-1fce-4250-969f-ee1c24bb0465 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:09.332386 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7fb34298-1fce-4250-969f-ee1c24bb0465 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:09.342626 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7fb34298-1fce-4250-969f-ee1c24bb0465 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:09.344180 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7fb34298-1fce-4250-969f-ee1c24bb0465 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:09.345389 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-7fb34298-1fce-4250-969f-ee1c24bb0465 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1809 microversion: 2.20 time: 0.162251 Jun 08 02:09:09.346000 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 230/444] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:09:09 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:09:09.494681 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5c22b037-5c07-46c0-8098-0d96d5fa4585 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:09.495281 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5c22b037-5c07-46c0-8098-0d96d5fa4585 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: dc44145c-7cae-45fa-b339-fd2b3c42e275] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:09.501931 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5c22b037-5c07-46c0-8098-0d96d5fa4585 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:09.502375 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5c22b037-5c07-46c0-8098-0d96d5fa4585 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:09.503142 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5c22b037-5c07-46c0-8098-0d96d5fa4585 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:09.503574 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5c22b037-5c07-46c0-8098-0d96d5fa4585 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:09.665181 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5c22b037-5c07-46c0-8098-0d96d5fa4585 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:09.673735 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5c22b037-5c07-46c0-8098-0d96d5fa4585 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275" status: 200 len: 1560 microversion: 2.1 time: 0.183515 Jun 08 02:09:09.674303 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 215/445] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:09 2022] GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275 => generated 1560 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:09.761585 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a57345d0-f629-4174-b18c-956470bdcfd1 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:09.762074 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a57345d0-f629-4174-b18c-956470bdcfd1 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:09.768127 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a57345d0-f629-4174-b18c-956470bdcfd1 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:09.768690 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a57345d0-f629-4174-b18c-956470bdcfd1 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:09.769445 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a57345d0-f629-4174-b18c-956470bdcfd1 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:09.769883 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a57345d0-f629-4174-b18c-956470bdcfd1 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:09.856415 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.objects.instance [None req-a57345d0-f629-4174-b18c-956470bdcfd1 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lazy-loading 'services' on Instance uuid b508446f-daa7-46a1-be64-fd8528cfa380 {{(pid=117939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 02:09:09.940316 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a57345d0-f629-4174-b18c-956470bdcfd1 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380/os-volume_attachments/8530e044-f3bd-4a15-a839-61e412c2cdd6" status: 202 len: 0 microversion: 2.1 time: 0.182533 Jun 08 02:09:09.941429 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 231/446] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jun 8 02:09:09 2022] DELETE /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380/os-volume_attachments/8530e044-f3bd-4a15-a839-61e412c2cdd6 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 02:09:10.364755 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5d31258f-cf05-4394-bb46-ccecc0eecfd6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:10.365340 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5d31258f-cf05-4394-bb46-ccecc0eecfd6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:10.372242 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5d31258f-cf05-4394-bb46-ccecc0eecfd6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:10.372721 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5d31258f-cf05-4394-bb46-ccecc0eecfd6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:10.373491 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5d31258f-cf05-4394-bb46-ccecc0eecfd6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:10.373922 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5d31258f-cf05-4394-bb46-ccecc0eecfd6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:10.519418 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5d31258f-cf05-4394-bb46-ccecc0eecfd6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:10.528072 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5d31258f-cf05-4394-bb46-ccecc0eecfd6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:10.529593 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5d31258f-cf05-4394-bb46-ccecc0eecfd6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:10.530733 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5d31258f-cf05-4394-bb46-ccecc0eecfd6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1809 microversion: 2.20 time: 0.170031 Jun 08 02:09:10.531276 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 216/447] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:09:10 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:09:10.692219 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-004a8826-99ad-4fe6-b05c-2c5fc1ad2545 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:10.692985 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-004a8826-99ad-4fe6-b05c-2c5fc1ad2545 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: dc44145c-7cae-45fa-b339-fd2b3c42e275] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:10.699863 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-004a8826-99ad-4fe6-b05c-2c5fc1ad2545 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:10.700316 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-004a8826-99ad-4fe6-b05c-2c5fc1ad2545 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:10.701123 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-004a8826-99ad-4fe6-b05c-2c5fc1ad2545 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:10.701557 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-004a8826-99ad-4fe6-b05c-2c5fc1ad2545 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:10.837763 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-004a8826-99ad-4fe6-b05c-2c5fc1ad2545 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:10.845873 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-004a8826-99ad-4fe6-b05c-2c5fc1ad2545 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275" status: 200 len: 1560 microversion: 2.1 time: 0.158458 Jun 08 02:09:10.846438 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 232/448] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:10 2022] GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:11.550076 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0d675dd0-9f08-4a32-8038-dcb4ccbd0794 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:11.550766 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0d675dd0-9f08-4a32-8038-dcb4ccbd0794 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:11.557993 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0d675dd0-9f08-4a32-8038-dcb4ccbd0794 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:11.558442 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0d675dd0-9f08-4a32-8038-dcb4ccbd0794 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:11.559209 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0d675dd0-9f08-4a32-8038-dcb4ccbd0794 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:11.559640 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0d675dd0-9f08-4a32-8038-dcb4ccbd0794 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:11.864026 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0c6675be-5378-4bf1-948a-ebbbc528652e tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:11.864703 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-0c6675be-5378-4bf1-948a-ebbbc528652e tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: dc44145c-7cae-45fa-b339-fd2b3c42e275] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:11.880682 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0c6675be-5378-4bf1-948a-ebbbc528652e tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:11.881181 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0c6675be-5378-4bf1-948a-ebbbc528652e tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:11.882409 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0c6675be-5378-4bf1-948a-ebbbc528652e tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:11.882874 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0c6675be-5378-4bf1-948a-ebbbc528652e tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:11.932425 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0d675dd0-9f08-4a32-8038-dcb4ccbd0794 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:11.948145 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0d675dd0-9f08-4a32-8038-dcb4ccbd0794 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:11.949711 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0d675dd0-9f08-4a32-8038-dcb4ccbd0794 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:11.950866 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0d675dd0-9f08-4a32-8038-dcb4ccbd0794 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1809 microversion: 2.20 time: 0.404712 Jun 08 02:09:11.951421 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 217/449] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:09:11 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1809 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:09:12.033915 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-0c6675be-5378-4bf1-948a-ebbbc528652e tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:12.042576 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-0c6675be-5378-4bf1-948a-ebbbc528652e tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275" status: 200 len: 1560 microversion: 2.1 time: 0.183387 Jun 08 02:09:12.043150 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 233/450] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:11 2022] GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275 => generated 1560 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:09:12.969402 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e1882474-54f5-4d36-8898-8ade38069fa4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:12.970062 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e1882474-54f5-4d36-8898-8ade38069fa4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:12.977045 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e1882474-54f5-4d36-8898-8ade38069fa4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:12.977491 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e1882474-54f5-4d36-8898-8ade38069fa4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:12.978252 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e1882474-54f5-4d36-8898-8ade38069fa4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:12.978684 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e1882474-54f5-4d36-8898-8ade38069fa4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:13.061523 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-dc84da54-3f3b-4add-9f2d-e5c51e82ea96 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:13.062805 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-dc84da54-3f3b-4add-9f2d-e5c51e82ea96 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: dc44145c-7cae-45fa-b339-fd2b3c42e275] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:13.073723 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-dc84da54-3f3b-4add-9f2d-e5c51e82ea96 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:13.075241 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-dc84da54-3f3b-4add-9f2d-e5c51e82ea96 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:13.076577 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-dc84da54-3f3b-4add-9f2d-e5c51e82ea96 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:13.077268 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-dc84da54-3f3b-4add-9f2d-e5c51e82ea96 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:13.116747 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e1882474-54f5-4d36-8898-8ade38069fa4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:13.128380 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e1882474-54f5-4d36-8898-8ade38069fa4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:13.130012 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e1882474-54f5-4d36-8898-8ade38069fa4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:13.132040 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e1882474-54f5-4d36-8898-8ade38069fa4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1809 microversion: 2.20 time: 0.165733 Jun 08 02:09:13.132703 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 218/451] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:09:12 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:09:13.225891 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-dc84da54-3f3b-4add-9f2d-e5c51e82ea96 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:13.233383 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-dc84da54-3f3b-4add-9f2d-e5c51e82ea96 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275" status: 200 len: 1514 microversion: 2.1 time: 0.176795 Jun 08 02:09:13.233937 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 234/452] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:13 2022] GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275 => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:09:14.150647 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-09049c31-e6a5-4775-92e4-5024bfee83b3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:14.151277 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-09049c31-e6a5-4775-92e4-5024bfee83b3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:14.157719 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-09049c31-e6a5-4775-92e4-5024bfee83b3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:14.158416 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-09049c31-e6a5-4775-92e4-5024bfee83b3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:14.159160 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-09049c31-e6a5-4775-92e4-5024bfee83b3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:14.159585 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-09049c31-e6a5-4775-92e4-5024bfee83b3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:14.250881 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c3208497-d34b-4bd6-910d-4697a2495e15 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:14.251488 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c3208497-d34b-4bd6-910d-4697a2495e15 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: dc44145c-7cae-45fa-b339-fd2b3c42e275] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:14.258283 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c3208497-d34b-4bd6-910d-4697a2495e15 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:14.258732 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c3208497-d34b-4bd6-910d-4697a2495e15 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:14.259496 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c3208497-d34b-4bd6-910d-4697a2495e15 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:14.259927 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c3208497-d34b-4bd6-910d-4697a2495e15 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:14.307444 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-09049c31-e6a5-4775-92e4-5024bfee83b3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:14.320683 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-09049c31-e6a5-4775-92e4-5024bfee83b3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:14.323108 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-09049c31-e6a5-4775-92e4-5024bfee83b3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:14.324297 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-09049c31-e6a5-4775-92e4-5024bfee83b3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1809 microversion: 2.20 time: 0.177801 Jun 08 02:09:14.324884 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 219/453] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:09:14 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:09:14.392193 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c3208497-d34b-4bd6-910d-4697a2495e15 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:14.400600 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c3208497-d34b-4bd6-910d-4697a2495e15 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275" status: 200 len: 1514 microversion: 2.1 time: 0.153430 Jun 08 02:09:14.401161 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 235/454] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:14 2022] GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:09:15.343776 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d599860a-974d-4c89-aedd-3e81c0721f15 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:15.344409 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d599860a-974d-4c89-aedd-3e81c0721f15 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:15.351115 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d599860a-974d-4c89-aedd-3e81c0721f15 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:15.351559 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d599860a-974d-4c89-aedd-3e81c0721f15 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:15.352314 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d599860a-974d-4c89-aedd-3e81c0721f15 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:15.352775 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d599860a-974d-4c89-aedd-3e81c0721f15 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:15.416939 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-1ac1180c-d8f0-44df-afed-2d82b304e6d3 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:15.417667 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-1ac1180c-d8f0-44df-afed-2d82b304e6d3 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: dc44145c-7cae-45fa-b339-fd2b3c42e275] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:15.424010 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1ac1180c-d8f0-44df-afed-2d82b304e6d3 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:15.424558 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1ac1180c-d8f0-44df-afed-2d82b304e6d3 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:15.425378 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1ac1180c-d8f0-44df-afed-2d82b304e6d3 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:15.425810 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1ac1180c-d8f0-44df-afed-2d82b304e6d3 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:15.513862 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d599860a-974d-4c89-aedd-3e81c0721f15 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:15.522503 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d599860a-974d-4c89-aedd-3e81c0721f15 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:15.524419 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d599860a-974d-4c89-aedd-3e81c0721f15 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:15.526446 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d599860a-974d-4c89-aedd-3e81c0721f15 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1809 microversion: 2.20 time: 0.186311 Jun 08 02:09:15.527205 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 220/455] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:09:15 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:09:15.575450 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1ac1180c-d8f0-44df-afed-2d82b304e6d3 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:15.582917 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-1ac1180c-d8f0-44df-afed-2d82b304e6d3 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275" status: 200 len: 1514 microversion: 2.1 time: 0.169824 Jun 08 02:09:15.583476 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 236/456] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:15 2022] GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:09:16.546615 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-411137d3-49a9-4aa8-965b-504e33604f7a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:16.547223 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-411137d3-49a9-4aa8-965b-504e33604f7a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:16.554508 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-411137d3-49a9-4aa8-965b-504e33604f7a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:16.554954 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-411137d3-49a9-4aa8-965b-504e33604f7a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:16.555713 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-411137d3-49a9-4aa8-965b-504e33604f7a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:16.556156 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-411137d3-49a9-4aa8-965b-504e33604f7a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:16.600683 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-713095f9-0c6d-46a0-9d8c-9b60d1587865 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:16.601321 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-713095f9-0c6d-46a0-9d8c-9b60d1587865 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: dc44145c-7cae-45fa-b339-fd2b3c42e275] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:16.607956 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-713095f9-0c6d-46a0-9d8c-9b60d1587865 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:16.608418 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-713095f9-0c6d-46a0-9d8c-9b60d1587865 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:16.609191 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-713095f9-0c6d-46a0-9d8c-9b60d1587865 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:16.609619 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-713095f9-0c6d-46a0-9d8c-9b60d1587865 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:16.870088 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-411137d3-49a9-4aa8-965b-504e33604f7a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:16.878909 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-411137d3-49a9-4aa8-965b-504e33604f7a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:16.880772 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-411137d3-49a9-4aa8-965b-504e33604f7a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:16.882684 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-411137d3-49a9-4aa8-965b-504e33604f7a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1809 microversion: 2.20 time: 0.340074 Jun 08 02:09:16.883342 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 221/457] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:09:16 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1809 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:09:16.914436 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-713095f9-0c6d-46a0-9d8c-9b60d1587865 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:16.922530 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-713095f9-0c6d-46a0-9d8c-9b60d1587865 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275" status: 200 len: 1514 microversion: 2.1 time: 0.326091 Jun 08 02:09:16.923100 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 237/458] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:16 2022] GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275 => generated 1514 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:09:17.193163 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-03ce5fe7-9df9-4100-be5a-57630a054af7 req-2fbd435b-92a0-489d-b08f-cf655d15f65b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc44145c-7cae-45fa-b339-fd2b3c42e275", "name": "network-vif-deleted", "tag": "f93bc63e-095b-4667-bb36-f91a3d9f2379"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:09:17.204179 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-03ce5fe7-9df9-4100-be5a-57630a054af7 req-2fbd435b-92a0-489d-b08f-cf655d15f65b service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:17.204892 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-03ce5fe7-9df9-4100-be5a-57630a054af7 req-2fbd435b-92a0-489d-b08f-cf655d15f65b service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:17.217019 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-03ce5fe7-9df9-4100-be5a-57630a054af7 req-2fbd435b-92a0-489d-b08f-cf655d15f65b service nova] Creating event network-vif-deleted:f93bc63e-095b-4667-bb36-f91a3d9f2379 for instance dc44145c-7cae-45fa-b339-fd2b3c42e275 on hv-cinder-84506 Jun 08 02:09:17.222502 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-03ce5fe7-9df9-4100-be5a-57630a054af7 req-2fbd435b-92a0-489d-b08f-cf655d15f65b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032921 Jun 08 02:09:17.223582 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 222/459] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:09:17.406303 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-094ef4c8-c600-4938-9cbf-6ce89cb60022 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:09:17.418446 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-094ef4c8-c600-4938-9cbf-6ce89cb60022 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:17.418894 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-094ef4c8-c600-4938-9cbf-6ce89cb60022 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:17.441729 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-094ef4c8-c600-4938-9cbf-6ce89cb60022 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Going to try to stop instance {{(pid=117939) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 08 02:09:17.486865 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-094ef4c8-c600-4938-9cbf-6ce89cb60022 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "POST /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380/action" status: 202 len: 0 microversion: 2.1 time: 0.084963 Jun 08 02:09:17.487462 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 238/460] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jun 8 02:09:17 2022] POST /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 02:09:17.496573 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-03761388-a86d-419d-ac78-7d4508699b6a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:17.497271 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-03761388-a86d-419d-ac78-7d4508699b6a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:17.503390 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-03761388-a86d-419d-ac78-7d4508699b6a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:17.503834 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-03761388-a86d-419d-ac78-7d4508699b6a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:17.504636 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-03761388-a86d-419d-ac78-7d4508699b6a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:17.505073 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-03761388-a86d-419d-ac78-7d4508699b6a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:17.640841 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-03761388-a86d-419d-ac78-7d4508699b6a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:17.643190 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=100 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:09:17.650269 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-03761388-a86d-419d-ac78-7d4508699b6a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1677 microversion: 2.1 time: 0.158085 Jun 08 02:09:17.650855 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 223/461] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:17 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:17.901341 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c9099d76-6164-4fec-a325-bba7b7acc14c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:17.901954 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c9099d76-6164-4fec-a325-bba7b7acc14c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:17.909030 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c9099d76-6164-4fec-a325-bba7b7acc14c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:17.910099 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c9099d76-6164-4fec-a325-bba7b7acc14c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:17.910878 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c9099d76-6164-4fec-a325-bba7b7acc14c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:17.911312 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c9099d76-6164-4fec-a325-bba7b7acc14c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:17.940048 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d6f027f4-192d-4976-91b3-d4f5fbcce30f tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:17.940687 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d6f027f4-192d-4976-91b3-d4f5fbcce30f tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: dc44145c-7cae-45fa-b339-fd2b3c42e275] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:17.949196 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d6f027f4-192d-4976-91b3-d4f5fbcce30f tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:17.949639 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d6f027f4-192d-4976-91b3-d4f5fbcce30f tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:17.950393 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d6f027f4-192d-4976-91b3-d4f5fbcce30f tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:17.950819 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d6f027f4-192d-4976-91b3-d4f5fbcce30f tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:17.964950 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-d6f027f4-192d-4976-91b3-d4f5fbcce30f tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] HTTP exception thrown: Instance dc44145c-7cae-45fa-b339-fd2b3c42e275 could not be found. Jun 08 02:09:17.966576 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d6f027f4-192d-4976-91b3-d4f5fbcce30f tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Request method failure captured: Jun 08 02:09:17.966576 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275 HTTP/1.1 Jun 08 02:09:17.966576 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept: application/json Jun 08 02:09:17.966576 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jun 08 02:09:17.966576 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Connection: close Jun 08 02:09:17.966576 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jun 08 02:09:17.966576 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jun 08 02:09:17.966576 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Host: 10.222.0.20 Jun 08 02:09:17.966576 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jun 08 02:09:17.966576 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jun 08 02:09:17.966576 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABioARuApmH_DyDVaVlq4lg3fzECGd01AdMgqOWvXc4Bx5LVJsVnTe6f8TlK2Do0UzUt-5hzb2aGY27PH8wDwYdcPD8iwfZOdWZYlKW3cj1VTBF_-FXZ37NX9v18kIq-gFl0V9XTy4TiryKVgnRyvmIv035rA6S_GcH0v-RWjBTLsR6O-8 Jun 08 02:09:17.966576 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jun 08 02:09:17.966576 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jun 08 02:09:17.966576 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jun 08 02:09:17.966576 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jun 08 02:09:17.966576 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jun 08 02:09:17.966576 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jun 08 02:09:17.966576 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Id: 68cd7ed883a04e91b36482a8950b12d1 Jun 08 02:09:17.966576 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1139519056 Jun 08 02:09:17.966576 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jun 08 02:09:17.966576 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jun 08 02:09:17.968153 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68cd7ed883a04e91b36482a8950b12d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_68cd7ed883a04e91b36482a8950b12d1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/68cd7ed883a04e91b36482a8950b12d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68cd7ed883a04e91b36482a8950b12d1"}]}] Jun 08 02:09:17.968153 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-VolumesSnapshotTestJSON-1139519056 Jun 08 02:09:17.968153 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 68cd7ed883a04e91b36482a8950b12d1 Jun 08 02:09:17.968153 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1139519056 Jun 08 02:09:17.968153 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User: tempest-VolumesSnapshotTestJSON-1139519056-project Jun 08 02:09:17.968153 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jun 08 02:09:17.968153 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jun 08 02:09:17.968153 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Id: f9556a3adc6b40ee93c498fb98cd77ea Jun 08 02:09:17.968153 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-VolumesSnapshotTestJSON-1139519056-project Jun 08 02:09:17.968153 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: method: > Jun 08 02:09:17.968153 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: exception: Instance dc44145c-7cae-45fa-b339-fd2b3c42e275 could not be found. Jun 08 02:09:17.968153 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: action_args: {'id': 'dc44145c-7cae-45fa-b339-fd2b3c42e275'} Jun 08 02:09:17.969445 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:09:17.969445 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:09:17.969445 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:09:17.969445 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:09:17.969445 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:09:17.969445 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:09:17.969445 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:09:17.969445 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:09:17.969445 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:09:17.969445 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:09:17.969445 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc44145c-7cae-45fa-b339-fd2b3c42e275 could not be found. Jun 08 02:09:17.969445 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:09:17.969445 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:09:17.969445 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:09:17.969445 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:09:17.969445 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:09:17.969445 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:09:17.969445 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:09:17.969445 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:09:17.969445 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:09:17.970847 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:09:17.970847 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 02:09:17.970847 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 02:09:17.970847 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:09:17.970847 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:09:17.970847 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:09:17.970847 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:09:17.970847 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc44145c-7cae-45fa-b339-fd2b3c42e275 could not be found. Jun 08 02:09:17.970847 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:09:17.970847 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:09:17.970847 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:09:17.970847 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:09:17.970847 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:09:17.970847 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:09:17.970847 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:09:17.970847 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:09:17.970847 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc44145c-7cae-45fa-b339-fd2b3c42e275 could not be found. Jun 08 02:09:17.970847 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:09:17.972009 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d6f027f4-192d-4976-91b3-d4f5fbcce30f tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Returning 404 to user: Instance dc44145c-7cae-45fa-b339-fd2b3c42e275 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:09:17.972009 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d6f027f4-192d-4976-91b3-d4f5fbcce30f tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275" status: 404 len: 111 microversion: 2.1 time: 0.031674 Jun 08 02:09:17.972009 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 224/462] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:17 2022] GET /compute/v2.1/servers/dc44145c-7cae-45fa-b339-fd2b3c42e275 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 08 02:09:18.042669 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c9099d76-6164-4fec-a325-bba7b7acc14c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:18.052194 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c9099d76-6164-4fec-a325-bba7b7acc14c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:18.054057 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c9099d76-6164-4fec-a325-bba7b7acc14c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:18.055546 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c9099d76-6164-4fec-a325-bba7b7acc14c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1809 microversion: 2.20 time: 0.159355 Jun 08 02:09:18.056649 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 239/463] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:09:17 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:09:18.077945 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e311c145-b6d5-4ca7-8d0b-a9ca2b26d1f8 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f8b7c34-6efc-40b5-8c74-72b4032f835d"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:09:18.079081 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e311c145-b6d5-4ca7-8d0b-a9ca2b26d1f8 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:18.086558 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e311c145-b6d5-4ca7-8d0b-a9ca2b26d1f8 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:18.087075 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e311c145-b6d5-4ca7-8d0b-a9ca2b26d1f8 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:18.088120 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e311c145-b6d5-4ca7-8d0b-a9ca2b26d1f8 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:18.088589 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e311c145-b6d5-4ca7-8d0b-a9ca2b26d1f8 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:18.347776 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e311c145-b6d5-4ca7-8d0b-a9ca2b26d1f8 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "POST /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273570 Jun 08 02:09:18.348455 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 225/464] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jun 8 02:09:18 2022] POST /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 02:09:18.667474 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ef547a07-1a19-48cf-adcb-77e27b35a829 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:18.668010 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ef547a07-1a19-48cf-adcb-77e27b35a829 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:18.674072 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ef547a07-1a19-48cf-adcb-77e27b35a829 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:18.674517 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ef547a07-1a19-48cf-adcb-77e27b35a829 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:18.675272 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ef547a07-1a19-48cf-adcb-77e27b35a829 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:18.675706 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ef547a07-1a19-48cf-adcb-77e27b35a829 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:18.802999 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ef547a07-1a19-48cf-adcb-77e27b35a829 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:18.810420 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ef547a07-1a19-48cf-adcb-77e27b35a829 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1677 microversion: 2.1 time: 0.146841 Jun 08 02:09:18.810982 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 240/465] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:18 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:19.075564 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9a60a417-1e43-4c92-a072-06313c8c2e52 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:19.076246 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9a60a417-1e43-4c92-a072-06313c8c2e52 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:19.082351 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9a60a417-1e43-4c92-a072-06313c8c2e52 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:19.082788 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9a60a417-1e43-4c92-a072-06313c8c2e52 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:19.083565 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9a60a417-1e43-4c92-a072-06313c8c2e52 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:19.084685 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9a60a417-1e43-4c92-a072-06313c8c2e52 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:19.217466 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9a60a417-1e43-4c92-a072-06313c8c2e52 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:19.225796 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9a60a417-1e43-4c92-a072-06313c8c2e52 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:19.227283 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9a60a417-1e43-4c92-a072-06313c8c2e52 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:19.228494 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9a60a417-1e43-4c92-a072-06313c8c2e52 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1809 microversion: 2.20 time: 0.157609 Jun 08 02:09:19.229038 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 226/466] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:09:19 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:09:19.827218 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-3c3557d6-29ac-4c18-8cce-cfbe656ef000 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:19.827825 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-3c3557d6-29ac-4c18-8cce-cfbe656ef000 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:19.834773 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3c3557d6-29ac-4c18-8cce-cfbe656ef000 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:19.835229 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3c3557d6-29ac-4c18-8cce-cfbe656ef000 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:19.835969 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3c3557d6-29ac-4c18-8cce-cfbe656ef000 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:19.836420 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3c3557d6-29ac-4c18-8cce-cfbe656ef000 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:19.962494 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-3c3557d6-29ac-4c18-8cce-cfbe656ef000 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:19.969823 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-3c3557d6-29ac-4c18-8cce-cfbe656ef000 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1677 microversion: 2.1 time: 0.146432 Jun 08 02:09:19.970375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 241/467] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:19 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:20.246599 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6024878e-c9d5-49ec-a8b6-d585ec15cf32 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:20.247237 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6024878e-c9d5-49ec-a8b6-d585ec15cf32 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:20.253907 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6024878e-c9d5-49ec-a8b6-d585ec15cf32 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:20.254354 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6024878e-c9d5-49ec-a8b6-d585ec15cf32 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:20.255109 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6024878e-c9d5-49ec-a8b6-d585ec15cf32 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:20.255545 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6024878e-c9d5-49ec-a8b6-d585ec15cf32 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:20.383022 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6024878e-c9d5-49ec-a8b6-d585ec15cf32 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:20.391461 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6024878e-c9d5-49ec-a8b6-d585ec15cf32 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:20.392940 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6024878e-c9d5-49ec-a8b6-d585ec15cf32 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:20.394083 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6024878e-c9d5-49ec-a8b6-d585ec15cf32 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1809 microversion: 2.20 time: 0.151268 Jun 08 02:09:20.394633 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 227/468] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:09:20 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:09:20.987293 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e33ce6ad-2d7b-4da6-8983-4a1a6d810c63 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:20.987899 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e33ce6ad-2d7b-4da6-8983-4a1a6d810c63 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:20.994510 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e33ce6ad-2d7b-4da6-8983-4a1a6d810c63 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:20.994954 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e33ce6ad-2d7b-4da6-8983-4a1a6d810c63 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:20.995710 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e33ce6ad-2d7b-4da6-8983-4a1a6d810c63 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:20.996142 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e33ce6ad-2d7b-4da6-8983-4a1a6d810c63 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:21.123883 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e33ce6ad-2d7b-4da6-8983-4a1a6d810c63 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:21.132203 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e33ce6ad-2d7b-4da6-8983-4a1a6d810c63 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1677 microversion: 2.1 time: 0.148645 Jun 08 02:09:21.132803 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 242/469] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:20 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:21.414496 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d530ea0e-b011-4c0d-99d6-bb06ed69aeaa tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:21.415096 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d530ea0e-b011-4c0d-99d6-bb06ed69aeaa tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:21.421747 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d530ea0e-b011-4c0d-99d6-bb06ed69aeaa tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:21.422180 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d530ea0e-b011-4c0d-99d6-bb06ed69aeaa tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:21.422941 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d530ea0e-b011-4c0d-99d6-bb06ed69aeaa tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:21.423374 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d530ea0e-b011-4c0d-99d6-bb06ed69aeaa tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:21.512625 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-0a0ac4fe-b66d-4147-b4a4-71115c52b4fe req-736f9787-7d49-42c4-ab8b-1bd798df1dc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7944f2e-2294-4a69-bd4e-d51f50e73e56", "name": "network-vif-plugged", "status": "completed", "tag": "4c178719-6047-43d9-9d57-30618b0b060e"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:09:21.523618 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-0a0ac4fe-b66d-4147-b4a4-71115c52b4fe req-736f9787-7d49-42c4-ab8b-1bd798df1dc1 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:21.524047 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-0a0ac4fe-b66d-4147-b4a4-71115c52b4fe req-736f9787-7d49-42c4-ab8b-1bd798df1dc1 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:21.542172 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-0a0ac4fe-b66d-4147-b4a4-71115c52b4fe req-736f9787-7d49-42c4-ab8b-1bd798df1dc1 service nova] Creating event network-vif-plugged:4c178719-6047-43d9-9d57-30618b0b060e for instance b7944f2e-2294-4a69-bd4e-d51f50e73e56 on hv-cinder-84506 Jun 08 02:09:21.554353 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-0a0ac4fe-b66d-4147-b4a4-71115c52b4fe req-736f9787-7d49-42c4-ab8b-1bd798df1dc1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039290 Jun 08 02:09:21.554515 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 243/470] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 02:09:21.570657 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d530ea0e-b011-4c0d-99d6-bb06ed69aeaa tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:21.597481 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d530ea0e-b011-4c0d-99d6-bb06ed69aeaa tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:21.600165 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d530ea0e-b011-4c0d-99d6-bb06ed69aeaa tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:21.602480 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d530ea0e-b011-4c0d-99d6-bb06ed69aeaa tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1809 microversion: 2.20 time: 0.193161 Jun 08 02:09:21.603047 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 228/471] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:09:21 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:09:22.149776 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-48893be4-6cc1-42d5-be79-bbb9479dfb0a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:22.150384 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-48893be4-6cc1-42d5-be79-bbb9479dfb0a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:22.152776 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:09:22.158850 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-48893be4-6cc1-42d5-be79-bbb9479dfb0a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:22.159297 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-48893be4-6cc1-42d5-be79-bbb9479dfb0a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:22.160057 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-48893be4-6cc1-42d5-be79-bbb9479dfb0a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:22.160523 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-48893be4-6cc1-42d5-be79-bbb9479dfb0a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:22.176439 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:09:22.294402 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-48893be4-6cc1-42d5-be79-bbb9479dfb0a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:22.301735 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-48893be4-6cc1-42d5-be79-bbb9479dfb0a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1677 microversion: 2.1 time: 0.156327 Jun 08 02:09:22.302270 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 244/472] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:22 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:22.620853 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-615fd59b-2844-4f33-a007-c76a7d4ec6ac tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:22.621477 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-615fd59b-2844-4f33-a007-c76a7d4ec6ac tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:22.628223 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-615fd59b-2844-4f33-a007-c76a7d4ec6ac tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:22.628794 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-615fd59b-2844-4f33-a007-c76a7d4ec6ac tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:22.629547 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-615fd59b-2844-4f33-a007-c76a7d4ec6ac tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:22.630017 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-615fd59b-2844-4f33-a007-c76a7d4ec6ac tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:22.768889 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-615fd59b-2844-4f33-a007-c76a7d4ec6ac tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:22.778877 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-615fd59b-2844-4f33-a007-c76a7d4ec6ac tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:22.780902 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-615fd59b-2844-4f33-a007-c76a7d4ec6ac tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:22.782456 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-615fd59b-2844-4f33-a007-c76a7d4ec6ac tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1809 microversion: 2.20 time: 0.165504 Jun 08 02:09:22.794631 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 229/473] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:09:22 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:09:23.319161 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-05806a12-7af8-4a94-a878-5c30cb84308c tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:23.319884 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-05806a12-7af8-4a94-a878-5c30cb84308c tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:23.329149 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-05806a12-7af8-4a94-a878-5c30cb84308c tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:23.329528 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-05806a12-7af8-4a94-a878-5c30cb84308c tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:23.330299 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-05806a12-7af8-4a94-a878-5c30cb84308c tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:23.331151 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-05806a12-7af8-4a94-a878-5c30cb84308c tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:23.514825 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-05806a12-7af8-4a94-a878-5c30cb84308c tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:23.522391 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-05806a12-7af8-4a94-a878-5c30cb84308c tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1677 microversion: 2.1 time: 0.207037 Jun 08 02:09:23.523031 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 245/474] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:23 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1677 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:23.774469 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7168a991-5296-403d-b621-c482fd732e92 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:09:23.775550 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7168a991-5296-403d-b621-c482fd732e92 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:23.782029 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7168a991-5296-403d-b621-c482fd732e92 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:23.782545 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7168a991-5296-403d-b621-c482fd732e92 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:23.783567 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7168a991-5296-403d-b621-c482fd732e92 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:23.783999 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7168a991-5296-403d-b621-c482fd732e92 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:23.802161 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-82711fb7-7d43-44fd-9578-c69bf0638665 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:23.802987 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-82711fb7-7d43-44fd-9578-c69bf0638665 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:23.808460 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-7168a991-5296-403d-b621-c482fd732e92 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lazy-loading 'flavor' on Instance uuid 596fe635-9554-4305-b88e-67139f06a3d0 {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 02:09:23.809538 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-82711fb7-7d43-44fd-9578-c69bf0638665 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:23.809979 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-82711fb7-7d43-44fd-9578-c69bf0638665 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:23.810742 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-82711fb7-7d43-44fd-9578-c69bf0638665 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:23.811332 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-82711fb7-7d43-44fd-9578-c69bf0638665 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:23.948245 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-82711fb7-7d43-44fd-9578-c69bf0638665 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:23.948910 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7168a991-5296-403d-b621-c482fd732e92 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "POST /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0/action" status: 200 len: 32 microversion: 2.1 time: 0.178560 Jun 08 02:09:23.949513 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 230/475] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jun 8 02:09:23 2022] POST /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0/action => generated 32 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 08 02:09:23.958456 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-45c7f83e-44a6-4999-8659-e31cc195c9d5 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:23.959142 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-45c7f83e-44a6-4999-8659-e31cc195c9d5 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:23.959326 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-82711fb7-7d43-44fd-9578-c69bf0638665 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:23.960895 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-82711fb7-7d43-44fd-9578-c69bf0638665 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:23.962687 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-82711fb7-7d43-44fd-9578-c69bf0638665 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1809 microversion: 2.20 time: 0.164402 Jun 08 02:09:23.963234 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 246/476] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:09:23 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 02:09:23.968605 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-45c7f83e-44a6-4999-8659-e31cc195c9d5 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:23.969419 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-45c7f83e-44a6-4999-8659-e31cc195c9d5 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:23.970757 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-45c7f83e-44a6-4999-8659-e31cc195c9d5 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:23.971198 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-45c7f83e-44a6-4999-8659-e31cc195c9d5 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:24.097971 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-45c7f83e-44a6-4999-8659-e31cc195c9d5 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:24.106238 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-45c7f83e-44a6-4999-8659-e31cc195c9d5 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1735 microversion: 2.1 time: 0.151681 Jun 08 02:09:24.106798 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 231/477] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:23 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:09:24.543219 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c816db7f-71dd-4787-9373-e24a75fb0a05 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:24.543834 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c816db7f-71dd-4787-9373-e24a75fb0a05 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:24.550242 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c816db7f-71dd-4787-9373-e24a75fb0a05 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:24.550682 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c816db7f-71dd-4787-9373-e24a75fb0a05 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:24.551431 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c816db7f-71dd-4787-9373-e24a75fb0a05 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:24.551859 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c816db7f-71dd-4787-9373-e24a75fb0a05 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:24.679673 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c816db7f-71dd-4787-9373-e24a75fb0a05 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:24.687812 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c816db7f-71dd-4787-9373-e24a75fb0a05 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1677 microversion: 2.1 time: 0.148947 Jun 08 02:09:24.688366 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 247/478] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:24 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:24.982960 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b9a27a07-3eea-4a9c-a8a6-409e1e79dddc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:24.983562 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b9a27a07-3eea-4a9c-a8a6-409e1e79dddc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:24.986039 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=58 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:09:24.991865 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b9a27a07-3eea-4a9c-a8a6-409e1e79dddc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:24.992309 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b9a27a07-3eea-4a9c-a8a6-409e1e79dddc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:24.993483 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b9a27a07-3eea-4a9c-a8a6-409e1e79dddc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:24.994247 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b9a27a07-3eea-4a9c-a8a6-409e1e79dddc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:25.123410 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-822e2e28-2de6-4f7c-a137-a4851d7f61dc tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:25.124009 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-822e2e28-2de6-4f7c-a137-a4851d7f61dc tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:25.129940 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-822e2e28-2de6-4f7c-a137-a4851d7f61dc tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:25.130390 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-822e2e28-2de6-4f7c-a137-a4851d7f61dc tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:25.131156 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-822e2e28-2de6-4f7c-a137-a4851d7f61dc tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:25.131590 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-822e2e28-2de6-4f7c-a137-a4851d7f61dc tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:25.131710 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b9a27a07-3eea-4a9c-a8a6-409e1e79dddc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:25.140568 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b9a27a07-3eea-4a9c-a8a6-409e1e79dddc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:25.142082 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b9a27a07-3eea-4a9c-a8a6-409e1e79dddc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:25.143210 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b9a27a07-3eea-4a9c-a8a6-409e1e79dddc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1809 microversion: 2.20 time: 0.164111 Jun 08 02:09:25.143762 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 232/479] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:09:24 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:09:25.259594 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-822e2e28-2de6-4f7c-a137-a4851d7f61dc tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:25.267657 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-822e2e28-2de6-4f7c-a137-a4851d7f61dc tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1735 microversion: 2.1 time: 0.148139 Jun 08 02:09:25.268219 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 248/480] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:25 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:09:25.705103 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1ff86e75-6365-4557-a9ca-14587f3ca00f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:25.705704 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-1ff86e75-6365-4557-a9ca-14587f3ca00f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:25.711755 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1ff86e75-6365-4557-a9ca-14587f3ca00f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:25.712201 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1ff86e75-6365-4557-a9ca-14587f3ca00f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:25.712989 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1ff86e75-6365-4557-a9ca-14587f3ca00f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:25.713420 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1ff86e75-6365-4557-a9ca-14587f3ca00f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:25.845283 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-1ff86e75-6365-4557-a9ca-14587f3ca00f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:25.852849 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1ff86e75-6365-4557-a9ca-14587f3ca00f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1677 microversion: 2.1 time: 0.151464 Jun 08 02:09:25.853412 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 233/481] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:25 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:26.162242 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f0ce05ef-913b-41d2-bd8d-a2efc0abbeed tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:26.162769 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f0ce05ef-913b-41d2-bd8d-a2efc0abbeed tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:26.169863 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f0ce05ef-913b-41d2-bd8d-a2efc0abbeed tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:26.170399 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f0ce05ef-913b-41d2-bd8d-a2efc0abbeed tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:26.171156 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f0ce05ef-913b-41d2-bd8d-a2efc0abbeed tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:26.171585 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f0ce05ef-913b-41d2-bd8d-a2efc0abbeed tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:26.286593 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b44dd9fe-aa0a-4841-956a-868fc02b8e55 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:26.287285 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b44dd9fe-aa0a-4841-956a-868fc02b8e55 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:26.294380 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b44dd9fe-aa0a-4841-956a-868fc02b8e55 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:26.294908 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b44dd9fe-aa0a-4841-956a-868fc02b8e55 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:26.295809 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b44dd9fe-aa0a-4841-956a-868fc02b8e55 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:26.296305 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b44dd9fe-aa0a-4841-956a-868fc02b8e55 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:26.298221 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f0ce05ef-913b-41d2-bd8d-a2efc0abbeed tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:26.307143 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f0ce05ef-913b-41d2-bd8d-a2efc0abbeed tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:26.308670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f0ce05ef-913b-41d2-bd8d-a2efc0abbeed tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:26.309813 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f0ce05ef-913b-41d2-bd8d-a2efc0abbeed tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1809 microversion: 2.20 time: 0.151832 Jun 08 02:09:26.310364 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 249/482] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:09:26 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:09:26.427733 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b44dd9fe-aa0a-4841-956a-868fc02b8e55 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:26.436376 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b44dd9fe-aa0a-4841-956a-868fc02b8e55 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1735 microversion: 2.1 time: 0.153875 Jun 08 02:09:26.437063 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 234/483] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:26 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:09:26.870206 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-9bca1201-2b9a-4561-8618-1c444234e18e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:26.870813 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-9bca1201-2b9a-4561-8618-1c444234e18e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:26.877001 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9bca1201-2b9a-4561-8618-1c444234e18e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:26.877240 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9bca1201-2b9a-4561-8618-1c444234e18e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:26.877991 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9bca1201-2b9a-4561-8618-1c444234e18e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:26.878418 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9bca1201-2b9a-4561-8618-1c444234e18e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:27.054471 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-9bca1201-2b9a-4561-8618-1c444234e18e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:27.062778 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-9bca1201-2b9a-4561-8618-1c444234e18e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1677 microversion: 2.1 time: 0.196834 Jun 08 02:09:27.063340 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 250/484] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:26 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1677 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:27.328188 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-71b19b43-87eb-43c8-88f3-36752f09a0c6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:27.328774 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-71b19b43-87eb-43c8-88f3-36752f09a0c6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:27.335514 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-71b19b43-87eb-43c8-88f3-36752f09a0c6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:27.335992 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-71b19b43-87eb-43c8-88f3-36752f09a0c6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:27.336980 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-71b19b43-87eb-43c8-88f3-36752f09a0c6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:27.337421 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-71b19b43-87eb-43c8-88f3-36752f09a0c6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:27.453717 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0a82fa66-84ea-4c2e-a851-3f7a0cda479f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:27.454458 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-0a82fa66-84ea-4c2e-a851-3f7a0cda479f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:27.460690 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0a82fa66-84ea-4c2e-a851-3f7a0cda479f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:27.461160 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0a82fa66-84ea-4c2e-a851-3f7a0cda479f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:27.461948 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0a82fa66-84ea-4c2e-a851-3f7a0cda479f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:27.462475 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0a82fa66-84ea-4c2e-a851-3f7a0cda479f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:27.471959 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-71b19b43-87eb-43c8-88f3-36752f09a0c6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:27.481388 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-71b19b43-87eb-43c8-88f3-36752f09a0c6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:27.482873 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-71b19b43-87eb-43c8-88f3-36752f09a0c6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:27.484016 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-71b19b43-87eb-43c8-88f3-36752f09a0c6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1809 microversion: 2.20 time: 0.160006 Jun 08 02:09:27.484601 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 235/485] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:09:27 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:09:27.592018 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-0a82fa66-84ea-4c2e-a851-3f7a0cda479f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:27.599871 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-0a82fa66-84ea-4c2e-a851-3f7a0cda479f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1735 microversion: 2.1 time: 0.149990 Jun 08 02:09:27.600775 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 251/486] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:27 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:27.979009 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2da6a2ad-7e8a-4a4b-bca0-70a917de5382 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1843367096", "imageRef": "e648e482-e374-429d-8152-a4a63797f314", "flavorRef": "452", "networks": [{"uuid": "0805388c-c568-4da3-817b-3be9b163906b"}]}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:09:28.038129 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.network.neutron [None req-2da6a2ad-7e8a-4a4b-bca0-70a917de5382 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] validate_networks() for [('0805388c-c568-4da3-817b-3be9b163906b', None, None, None, None, None)] {{(pid=117938) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 02:09:28.080989 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-086996d2-9996-45d9-bc06-19ea5f7b9833 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:28.081687 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-086996d2-9996-45d9-bc06-19ea5f7b9833 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:28.089389 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-086996d2-9996-45d9-bc06-19ea5f7b9833 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:28.090043 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-086996d2-9996-45d9-bc06-19ea5f7b9833 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:28.090991 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-086996d2-9996-45d9-bc06-19ea5f7b9833 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:28.091626 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-086996d2-9996-45d9-bc06-19ea5f7b9833 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:28.270190 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-086996d2-9996-45d9-bc06-19ea5f7b9833 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:28.278411 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-086996d2-9996-45d9-bc06-19ea5f7b9833 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1677 microversion: 2.1 time: 0.201633 Jun 08 02:09:28.279354 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 252/487] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:28 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1677 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:09:28.450981 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-2da6a2ad-7e8a-4a4b-bca0-70a917de5382 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Flavor limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 02:09:28.451476 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-2da6a2ad-7e8a-4a4b-bca0-70a917de5382 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Image limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 02:09:28.451868 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-2da6a2ad-7e8a-4a4b-bca0-70a917de5382 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Flavor pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 02:09:28.452269 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-2da6a2ad-7e8a-4a4b-bca0-70a917de5382 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Image pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 02:09:28.452734 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-2da6a2ad-7e8a-4a4b-bca0-70a917de5382 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 02:09:28.462185 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2da6a2ad-7e8a-4a4b-bca0-70a917de5382 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:28.462646 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2da6a2ad-7e8a-4a4b-bca0-70a917de5382 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:28.463450 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2da6a2ad-7e8a-4a4b-bca0-70a917de5382 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:28.463886 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2da6a2ad-7e8a-4a4b-bca0-70a917de5382 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:28.480929 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-2da6a2ad-7e8a-4a4b-bca0-70a917de5382 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Getting quotas for project 68cd7ed883a04e91b36482a8950b12d1. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 02:09:28.484908 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-2da6a2ad-7e8a-4a4b-bca0-70a917de5382 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Getting quotas for user f9556a3adc6b40ee93c498fb98cd77ea and project 68cd7ed883a04e91b36482a8950b12d1. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 02:09:28.496336 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2da6a2ad-7e8a-4a4b-bca0-70a917de5382 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Going to run 1 instances... {{(pid=117938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 02:09:28.498625 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2da6a2ad-7e8a-4a4b-bca0-70a917de5382 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: 3cc699b5-d7f5-466e-9882-a80368641bac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e648e482-e374-429d-8152-a4a63797f314',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 02:09:28.502800 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-fa6b8848-4282-4293-a4dd-311a7f01f2c0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:28.503410 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-fa6b8848-4282-4293-a4dd-311a7f01f2c0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:28.510035 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fa6b8848-4282-4293-a4dd-311a7f01f2c0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:28.510412 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fa6b8848-4282-4293-a4dd-311a7f01f2c0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:28.511297 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fa6b8848-4282-4293-a4dd-311a7f01f2c0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:28.511769 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fa6b8848-4282-4293-a4dd-311a7f01f2c0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:28.546217 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2da6a2ad-7e8a-4a4b-bca0-70a917de5382 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571291 Jun 08 02:09:28.547126 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 236/488] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jun 8 02:09:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 08 02:09:28.556796 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4a2a3ad1-c2ca-4702-bc9e-7e472f8a3d3d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:28.557406 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4a2a3ad1-c2ca-4702-bc9e-7e472f8a3d3d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: 3cc699b5-d7f5-466e-9882-a80368641bac] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:28.617078 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4a2a3ad1-c2ca-4702-bc9e-7e472f8a3d3d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:28.628355 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4a2a3ad1-c2ca-4702-bc9e-7e472f8a3d3d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/3cc699b5-d7f5-466e-9882-a80368641bac" status: 200 len: 1219 microversion: 2.1 time: 0.071130 Jun 08 02:09:28.629216 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 237/489] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:28 2022] GET /compute/v2.1/servers/3cc699b5-d7f5-466e-9882-a80368641bac => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:28.634965 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f6da7d8d-0f17-45fd-bc6a-1a3e27c6bc22 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:28.635708 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f6da7d8d-0f17-45fd-bc6a-1a3e27c6bc22 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:28.642394 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f6da7d8d-0f17-45fd-bc6a-1a3e27c6bc22 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:28.643097 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f6da7d8d-0f17-45fd-bc6a-1a3e27c6bc22 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:28.643830 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f6da7d8d-0f17-45fd-bc6a-1a3e27c6bc22 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:28.644323 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f6da7d8d-0f17-45fd-bc6a-1a3e27c6bc22 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:28.681654 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-fa6b8848-4282-4293-a4dd-311a7f01f2c0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:28.690657 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-fa6b8848-4282-4293-a4dd-311a7f01f2c0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:28.692306 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-fa6b8848-4282-4293-a4dd-311a7f01f2c0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:28.693498 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-fa6b8848-4282-4293-a4dd-311a7f01f2c0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1796 microversion: 2.20 time: 0.194607 Jun 08 02:09:28.694044 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 253/490] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:09:28 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1796 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 02:09:28.788581 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f6da7d8d-0f17-45fd-bc6a-1a3e27c6bc22 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:28.796660 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f6da7d8d-0f17-45fd-bc6a-1a3e27c6bc22 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1735 microversion: 2.1 time: 0.166623 Jun 08 02:09:28.797228 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 238/491] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:28 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:29.295308 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-34f18848-16fd-4749-bf8f-05f936761656 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:29.295829 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-34f18848-16fd-4749-bf8f-05f936761656 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:29.301771 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-34f18848-16fd-4749-bf8f-05f936761656 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:29.302212 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-34f18848-16fd-4749-bf8f-05f936761656 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:29.302958 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-34f18848-16fd-4749-bf8f-05f936761656 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:29.303386 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-34f18848-16fd-4749-bf8f-05f936761656 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:29.448944 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-34f18848-16fd-4749-bf8f-05f936761656 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:29.456465 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-34f18848-16fd-4749-bf8f-05f936761656 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1677 microversion: 2.1 time: 0.164978 Jun 08 02:09:29.457030 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 254/492] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:29 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:29.645479 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-57085fd1-6220-4bd7-81c2-4e8ef10cd7d7 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:29.646085 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-57085fd1-6220-4bd7-81c2-4e8ef10cd7d7 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: 3cc699b5-d7f5-466e-9882-a80368641bac] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:29.652903 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-57085fd1-6220-4bd7-81c2-4e8ef10cd7d7 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:29.653381 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-57085fd1-6220-4bd7-81c2-4e8ef10cd7d7 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:29.654151 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-57085fd1-6220-4bd7-81c2-4e8ef10cd7d7 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:29.654585 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-57085fd1-6220-4bd7-81c2-4e8ef10cd7d7 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:29.672590 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:09:29.745637 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-57085fd1-6220-4bd7-81c2-4e8ef10cd7d7 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:29.754012 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-57085fd1-6220-4bd7-81c2-4e8ef10cd7d7 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/3cc699b5-d7f5-466e-9882-a80368641bac" status: 200 len: 1277 microversion: 2.1 time: 0.112325 Jun 08 02:09:29.763975 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 239/493] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:29 2022] GET /compute/v2.1/servers/3cc699b5-d7f5-466e-9882-a80368641bac => generated 1277 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:29.814541 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-8f92cc9b-729d-4ddb-b28f-2728fc5e0cfa tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:29.815422 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-8f92cc9b-729d-4ddb-b28f-2728fc5e0cfa tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:29.822179 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8f92cc9b-729d-4ddb-b28f-2728fc5e0cfa tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:29.822628 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8f92cc9b-729d-4ddb-b28f-2728fc5e0cfa tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:29.823397 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8f92cc9b-729d-4ddb-b28f-2728fc5e0cfa tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:29.823830 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8f92cc9b-729d-4ddb-b28f-2728fc5e0cfa tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:30.026980 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-8f92cc9b-729d-4ddb-b28f-2728fc5e0cfa tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:30.035664 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-8f92cc9b-729d-4ddb-b28f-2728fc5e0cfa tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1735 microversion: 2.1 time: 0.224953 Jun 08 02:09:30.036244 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 255/494] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:29 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1735 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:30.473821 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-edd37742-b7c4-43b5-8d26-81647752be7e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:30.474346 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-edd37742-b7c4-43b5-8d26-81647752be7e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:30.480910 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-edd37742-b7c4-43b5-8d26-81647752be7e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:30.481365 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-edd37742-b7c4-43b5-8d26-81647752be7e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:30.482152 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-edd37742-b7c4-43b5-8d26-81647752be7e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:30.482589 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-edd37742-b7c4-43b5-8d26-81647752be7e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:30.771055 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d175a732-9244-4399-ab88-8d7c4e2b2db6 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:30.771660 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d175a732-9244-4399-ab88-8d7c4e2b2db6 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: 3cc699b5-d7f5-466e-9882-a80368641bac] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:30.778927 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d175a732-9244-4399-ab88-8d7c4e2b2db6 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:30.779376 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d175a732-9244-4399-ab88-8d7c4e2b2db6 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:30.780132 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d175a732-9244-4399-ab88-8d7c4e2b2db6 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:30.780592 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d175a732-9244-4399-ab88-8d7c4e2b2db6 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:30.926365 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-edd37742-b7c4-43b5-8d26-81647752be7e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:30.934679 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-edd37742-b7c4-43b5-8d26-81647752be7e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1677 microversion: 2.1 time: 0.464810 Jun 08 02:09:30.935333 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 240/495] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:30 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1677 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:31.004815 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d175a732-9244-4399-ab88-8d7c4e2b2db6 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:31.012484 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d175a732-9244-4399-ab88-8d7c4e2b2db6 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/3cc699b5-d7f5-466e-9882-a80368641bac" status: 200 len: 1319 microversion: 2.1 time: 0.245181 Jun 08 02:09:31.013234 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 256/496] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:30 2022] GET /compute/v2.1/servers/3cc699b5-d7f5-466e-9882-a80368641bac => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:09:31.053347 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-273281b5-5957-478a-9386-8e8e817cafab tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:31.053944 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-273281b5-5957-478a-9386-8e8e817cafab tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:31.059871 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-273281b5-5957-478a-9386-8e8e817cafab tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:31.060318 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-273281b5-5957-478a-9386-8e8e817cafab tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:31.061190 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-273281b5-5957-478a-9386-8e8e817cafab tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:31.061649 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-273281b5-5957-478a-9386-8e8e817cafab tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:31.274935 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-273281b5-5957-478a-9386-8e8e817cafab tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:31.283014 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-273281b5-5957-478a-9386-8e8e817cafab tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1735 microversion: 2.1 time: 0.233277 Jun 08 02:09:31.283585 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 241/497] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:31 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1735 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:31.413539 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-0bec198f-0510-4fc1-86c7-853a0faf873e req-c1635994-d52e-4e1f-b796-735abda1f29a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cc699b5-d7f5-466e-9882-a80368641bac", "tag": "46f78d55-b541-47ea-88b7-8af0f92f361f"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:09:31.425954 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-0bec198f-0510-4fc1-86c7-853a0faf873e req-c1635994-d52e-4e1f-b796-735abda1f29a service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:31.426403 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-0bec198f-0510-4fc1-86c7-853a0faf873e req-c1635994-d52e-4e1f-b796-735abda1f29a service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:31.438463 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-0bec198f-0510-4fc1-86c7-853a0faf873e req-c1635994-d52e-4e1f-b796-735abda1f29a service nova] Creating event network-changed:46f78d55-b541-47ea-88b7-8af0f92f361f for instance 3cc699b5-d7f5-466e-9882-a80368641bac on hv-cinder-84506 Jun 08 02:09:31.443325 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-0bec198f-0510-4fc1-86c7-853a0faf873e req-c1635994-d52e-4e1f-b796-735abda1f29a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033485 Jun 08 02:09:31.443982 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 257/498] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:09:31.952236 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6bb03dfa-616e-43a0-b04f-367251d59588 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:31.952869 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6bb03dfa-616e-43a0-b04f-367251d59588 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:31.959287 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6bb03dfa-616e-43a0-b04f-367251d59588 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:31.959731 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6bb03dfa-616e-43a0-b04f-367251d59588 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:31.960500 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6bb03dfa-616e-43a0-b04f-367251d59588 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:31.961532 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6bb03dfa-616e-43a0-b04f-367251d59588 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:32.030388 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-1d2687ca-a848-40d5-be34-2b6042b8ccab tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:32.031117 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-1d2687ca-a848-40d5-be34-2b6042b8ccab tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: 3cc699b5-d7f5-466e-9882-a80368641bac] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:32.037520 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1d2687ca-a848-40d5-be34-2b6042b8ccab tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:32.037968 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1d2687ca-a848-40d5-be34-2b6042b8ccab tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:32.038728 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1d2687ca-a848-40d5-be34-2b6042b8ccab tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:32.039237 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1d2687ca-a848-40d5-be34-2b6042b8ccab tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:32.121773 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6bb03dfa-616e-43a0-b04f-367251d59588 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:32.140144 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6bb03dfa-616e-43a0-b04f-367251d59588 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1677 microversion: 2.1 time: 0.191626 Jun 08 02:09:32.140941 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 242/499] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:31 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1677 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:32.189704 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1d2687ca-a848-40d5-be34-2b6042b8ccab tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:32.197719 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-1d2687ca-a848-40d5-be34-2b6042b8ccab tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/3cc699b5-d7f5-466e-9882-a80368641bac" status: 200 len: 1319 microversion: 2.1 time: 0.172096 Jun 08 02:09:32.198278 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 258/500] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:32 2022] GET /compute/v2.1/servers/3cc699b5-d7f5-466e-9882-a80368641bac => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:09:32.300347 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a59bee70-2427-4059-8fc8-3b12f1475006 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:32.300995 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a59bee70-2427-4059-8fc8-3b12f1475006 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:32.307529 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a59bee70-2427-4059-8fc8-3b12f1475006 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:32.307965 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a59bee70-2427-4059-8fc8-3b12f1475006 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:32.308740 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a59bee70-2427-4059-8fc8-3b12f1475006 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:32.309171 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a59bee70-2427-4059-8fc8-3b12f1475006 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:32.435615 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a59bee70-2427-4059-8fc8-3b12f1475006 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:32.443483 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a59bee70-2427-4059-8fc8-3b12f1475006 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1735 microversion: 2.1 time: 0.146923 Jun 08 02:09:32.444040 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 243/501] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:32 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:33.158277 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2af0d1e0-c620-410c-8a8f-94b5340cb4da tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:33.158886 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-2af0d1e0-c620-410c-8a8f-94b5340cb4da tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:33.166050 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2af0d1e0-c620-410c-8a8f-94b5340cb4da tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:33.166435 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2af0d1e0-c620-410c-8a8f-94b5340cb4da tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:33.167203 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2af0d1e0-c620-410c-8a8f-94b5340cb4da tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:33.167641 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2af0d1e0-c620-410c-8a8f-94b5340cb4da tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:33.215032 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7f6d64ef-c4f7-4a63-b009-1ce24b4ddbe1 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:33.215646 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7f6d64ef-c4f7-4a63-b009-1ce24b4ddbe1 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: 3cc699b5-d7f5-466e-9882-a80368641bac] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:33.222392 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7f6d64ef-c4f7-4a63-b009-1ce24b4ddbe1 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:33.222865 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7f6d64ef-c4f7-4a63-b009-1ce24b4ddbe1 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:33.223688 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7f6d64ef-c4f7-4a63-b009-1ce24b4ddbe1 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:33.224153 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7f6d64ef-c4f7-4a63-b009-1ce24b4ddbe1 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:33.448355 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2af0d1e0-c620-410c-8a8f-94b5340cb4da tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:33.455743 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2af0d1e0-c620-410c-8a8f-94b5340cb4da tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1654 microversion: 2.1 time: 0.301638 Jun 08 02:09:33.456699 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 259/502] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:33 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1654 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:09:33.461779 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-3ec5bcf7-c787-4c32-a5e3-0dd8feb2ee7f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:33.462463 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-3ec5bcf7-c787-4c32-a5e3-0dd8feb2ee7f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:33.468471 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3ec5bcf7-c787-4c32-a5e3-0dd8feb2ee7f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:33.468924 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3ec5bcf7-c787-4c32-a5e3-0dd8feb2ee7f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:33.469687 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3ec5bcf7-c787-4c32-a5e3-0dd8feb2ee7f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:33.470720 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3ec5bcf7-c787-4c32-a5e3-0dd8feb2ee7f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:33.497113 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7f6d64ef-c4f7-4a63-b009-1ce24b4ddbe1 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:33.504512 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7f6d64ef-c4f7-4a63-b009-1ce24b4ddbe1 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/3cc699b5-d7f5-466e-9882-a80368641bac" status: 200 len: 1319 microversion: 2.1 time: 0.293862 Jun 08 02:09:33.505168 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 244/503] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:33 2022] GET /compute/v2.1/servers/3cc699b5-d7f5-466e-9882-a80368641bac => generated 1319 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:33.510678 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4e0a965b-f25c-4d54-8766-29e71854042c tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:09:33.517008 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4e0a965b-f25c-4d54-8766-29e71854042c tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:33.517536 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4e0a965b-f25c-4d54-8766-29e71854042c tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:33.542739 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4e0a965b-f25c-4d54-8766-29e71854042c tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Going to try to start instance {{(pid=117938) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 08 02:09:33.591335 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4e0a965b-f25c-4d54-8766-29e71854042c tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "POST /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380/action" status: 202 len: 0 microversion: 2.1 time: 0.084855 Jun 08 02:09:33.592257 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 245/504] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jun 8 02:09:33 2022] POST /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 02:09:33.600636 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6b34c1aa-cf0d-40f2-b52a-4af628e5c88a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:33.601456 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6b34c1aa-cf0d-40f2-b52a-4af628e5c88a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:33.608239 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6b34c1aa-cf0d-40f2-b52a-4af628e5c88a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:33.608792 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6b34c1aa-cf0d-40f2-b52a-4af628e5c88a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:33.609626 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6b34c1aa-cf0d-40f2-b52a-4af628e5c88a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:33.610317 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6b34c1aa-cf0d-40f2-b52a-4af628e5c88a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:33.639500 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-3ec5bcf7-c787-4c32-a5e3-0dd8feb2ee7f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:33.647860 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-3ec5bcf7-c787-4c32-a5e3-0dd8feb2ee7f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1735 microversion: 2.1 time: 0.190178 Jun 08 02:09:33.649079 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 260/505] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:33 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1735 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:33.781563 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6b34c1aa-cf0d-40f2-b52a-4af628e5c88a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:33.789315 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6b34c1aa-cf0d-40f2-b52a-4af628e5c88a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1663 microversion: 2.1 time: 0.192733 Jun 08 02:09:33.790198 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 246/506] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:33 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1663 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:34.521699 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-18791002-c0da-44f5-a17b-5fd61c5cab4d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:34.522304 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-18791002-c0da-44f5-a17b-5fd61c5cab4d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: 3cc699b5-d7f5-466e-9882-a80368641bac] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:34.528933 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-18791002-c0da-44f5-a17b-5fd61c5cab4d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:34.529379 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-18791002-c0da-44f5-a17b-5fd61c5cab4d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:34.530133 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-18791002-c0da-44f5-a17b-5fd61c5cab4d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:34.530565 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-18791002-c0da-44f5-a17b-5fd61c5cab4d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:34.662446 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-18791002-c0da-44f5-a17b-5fd61c5cab4d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:34.664856 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=100 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:09:34.666234 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-42808da1-c51b-4906-907d-33b5db66817a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:34.666996 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-42808da1-c51b-4906-907d-33b5db66817a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:34.671270 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-18791002-c0da-44f5-a17b-5fd61c5cab4d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/3cc699b5-d7f5-466e-9882-a80368641bac" status: 200 len: 1319 microversion: 2.1 time: 0.153420 Jun 08 02:09:34.671840 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 261/507] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:34 2022] GET /compute/v2.1/servers/3cc699b5-d7f5-466e-9882-a80368641bac => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:34.673729 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-42808da1-c51b-4906-907d-33b5db66817a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:34.674258 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-42808da1-c51b-4906-907d-33b5db66817a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:34.675176 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-42808da1-c51b-4906-907d-33b5db66817a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:34.675683 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-42808da1-c51b-4906-907d-33b5db66817a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:34.802129 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-42808da1-c51b-4906-907d-33b5db66817a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:34.806924 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e9a6ba3f-2a45-4bfe-8494-cc6d19de1e37 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:34.807527 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e9a6ba3f-2a45-4bfe-8494-cc6d19de1e37 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:34.810646 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-42808da1-c51b-4906-907d-33b5db66817a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1735 microversion: 2.1 time: 0.148620 Jun 08 02:09:34.811222 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 247/508] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:34 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:09:34.813536 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e9a6ba3f-2a45-4bfe-8494-cc6d19de1e37 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:34.813982 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e9a6ba3f-2a45-4bfe-8494-cc6d19de1e37 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:34.814744 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e9a6ba3f-2a45-4bfe-8494-cc6d19de1e37 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:34.815177 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e9a6ba3f-2a45-4bfe-8494-cc6d19de1e37 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:34.941265 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e9a6ba3f-2a45-4bfe-8494-cc6d19de1e37 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:34.948878 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e9a6ba3f-2a45-4bfe-8494-cc6d19de1e37 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1663 microversion: 2.1 time: 0.146323 Jun 08 02:09:34.949441 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 262/509] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:34 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1663 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:09:35.687648 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-363edc9a-db36-4136-a709-c83d14517cf7 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:35.688207 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-363edc9a-db36-4136-a709-c83d14517cf7 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: 3cc699b5-d7f5-466e-9882-a80368641bac] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:35.694711 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-363edc9a-db36-4136-a709-c83d14517cf7 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:35.695644 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-363edc9a-db36-4136-a709-c83d14517cf7 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:35.696764 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-363edc9a-db36-4136-a709-c83d14517cf7 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:35.697198 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-363edc9a-db36-4136-a709-c83d14517cf7 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:35.827025 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-363edc9a-db36-4136-a709-c83d14517cf7 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:35.827662 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-237291f2-d109-4296-bc88-cb9f4fa1e597 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:35.828278 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-237291f2-d109-4296-bc88-cb9f4fa1e597 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:35.834415 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-363edc9a-db36-4136-a709-c83d14517cf7 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/3cc699b5-d7f5-466e-9882-a80368641bac" status: 200 len: 1319 microversion: 2.1 time: 0.150649 Jun 08 02:09:35.834688 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-237291f2-d109-4296-bc88-cb9f4fa1e597 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:35.834983 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 248/510] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:35 2022] GET /compute/v2.1/servers/3cc699b5-d7f5-466e-9882-a80368641bac => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:35.835149 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-237291f2-d109-4296-bc88-cb9f4fa1e597 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:35.836727 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-237291f2-d109-4296-bc88-cb9f4fa1e597 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:35.837174 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-237291f2-d109-4296-bc88-cb9f4fa1e597 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:35.966659 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-668ad208-73fc-45b5-ab47-94b1cb559e5a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:35.967231 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-668ad208-73fc-45b5-ab47-94b1cb559e5a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:35.972270 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-237291f2-d109-4296-bc88-cb9f4fa1e597 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:35.973947 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-668ad208-73fc-45b5-ab47-94b1cb559e5a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:35.974401 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-668ad208-73fc-45b5-ab47-94b1cb559e5a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:35.975170 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-668ad208-73fc-45b5-ab47-94b1cb559e5a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:35.975604 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-668ad208-73fc-45b5-ab47-94b1cb559e5a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:35.980287 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-237291f2-d109-4296-bc88-cb9f4fa1e597 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1735 microversion: 2.1 time: 0.156646 Jun 08 02:09:35.981030 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 263/511] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:35 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:09:36.109240 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-668ad208-73fc-45b5-ab47-94b1cb559e5a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:36.116846 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-668ad208-73fc-45b5-ab47-94b1cb559e5a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1667 microversion: 2.1 time: 0.153936 Jun 08 02:09:36.117576 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 249/512] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:35 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1667 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:09:36.852296 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d02b6787-11d9-4762-8608-ee2aa87cb0a6 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:36.852934 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d02b6787-11d9-4762-8608-ee2aa87cb0a6 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: 3cc699b5-d7f5-466e-9882-a80368641bac] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:36.858833 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d02b6787-11d9-4762-8608-ee2aa87cb0a6 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:36.859274 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d02b6787-11d9-4762-8608-ee2aa87cb0a6 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:36.860019 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d02b6787-11d9-4762-8608-ee2aa87cb0a6 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:36.860480 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d02b6787-11d9-4762-8608-ee2aa87cb0a6 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:36.987632 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d02b6787-11d9-4762-8608-ee2aa87cb0a6 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:36.995533 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d02b6787-11d9-4762-8608-ee2aa87cb0a6 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/3cc699b5-d7f5-466e-9882-a80368641bac" status: 200 len: 1319 microversion: 2.1 time: 0.147858 Jun 08 02:09:36.996115 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 264/513] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:36 2022] GET /compute/v2.1/servers/3cc699b5-d7f5-466e-9882-a80368641bac => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:36.996918 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f2a4d6d4-994f-48a4-ab40-6cfe441627e7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:36.997724 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f2a4d6d4-994f-48a4-ab40-6cfe441627e7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:37.004191 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f2a4d6d4-994f-48a4-ab40-6cfe441627e7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:37.004662 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f2a4d6d4-994f-48a4-ab40-6cfe441627e7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:37.005413 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f2a4d6d4-994f-48a4-ab40-6cfe441627e7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:37.005836 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f2a4d6d4-994f-48a4-ab40-6cfe441627e7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:37.135453 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f2a4d6d4-994f-48a4-ab40-6cfe441627e7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:37.143426 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f2a4d6d4-994f-48a4-ab40-6cfe441627e7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1735 microversion: 2.1 time: 0.150340 Jun 08 02:09:37.143997 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 250/514] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:36 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:09:37.568424 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-f505fd8a-2ed3-4683-b22d-c12efa5b2ca5 req-9d1351a0-4ec4-414c-a8bc-aecb3d187d82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc699b5-d7f5-466e-9882-a80368641bac", "name": "network-vif-plugged", "status": "completed", "tag": "46f78d55-b541-47ea-88b7-8af0f92f361f"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:09:37.577269 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-f505fd8a-2ed3-4683-b22d-c12efa5b2ca5 req-9d1351a0-4ec4-414c-a8bc-aecb3d187d82 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:37.577596 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-f505fd8a-2ed3-4683-b22d-c12efa5b2ca5 req-9d1351a0-4ec4-414c-a8bc-aecb3d187d82 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:37.591849 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-f505fd8a-2ed3-4683-b22d-c12efa5b2ca5 req-9d1351a0-4ec4-414c-a8bc-aecb3d187d82 service nova] Creating event network-vif-plugged:46f78d55-b541-47ea-88b7-8af0f92f361f for instance 3cc699b5-d7f5-466e-9882-a80368641bac on hv-cinder-84506 Jun 08 02:09:37.597729 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-f505fd8a-2ed3-4683-b22d-c12efa5b2ca5 req-9d1351a0-4ec4-414c-a8bc-aecb3d187d82 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033009 Jun 08 02:09:37.598571 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 265/515] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:09:38.012951 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5d86fcd8-e59d-4c04-bd77-537d1dbff803 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:38.013558 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5d86fcd8-e59d-4c04-bd77-537d1dbff803 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: 3cc699b5-d7f5-466e-9882-a80368641bac] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:38.019989 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5d86fcd8-e59d-4c04-bd77-537d1dbff803 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:38.020468 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5d86fcd8-e59d-4c04-bd77-537d1dbff803 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:38.021224 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5d86fcd8-e59d-4c04-bd77-537d1dbff803 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:38.021656 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5d86fcd8-e59d-4c04-bd77-537d1dbff803 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:38.159256 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5d86fcd8-e59d-4c04-bd77-537d1dbff803 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:38.161262 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-61986754-ee9f-4479-b83c-215523b5e68f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:38.161997 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-61986754-ee9f-4479-b83c-215523b5e68f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:38.169147 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-61986754-ee9f-4479-b83c-215523b5e68f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:38.169820 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-61986754-ee9f-4479-b83c-215523b5e68f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:38.170592 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-61986754-ee9f-4479-b83c-215523b5e68f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:38.171031 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-61986754-ee9f-4479-b83c-215523b5e68f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:38.171162 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5d86fcd8-e59d-4c04-bd77-537d1dbff803 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/3cc699b5-d7f5-466e-9882-a80368641bac" status: 200 len: 1319 microversion: 2.1 time: 0.162363 Jun 08 02:09:38.171743 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 251/516] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:38 2022] GET /compute/v2.1/servers/3cc699b5-d7f5-466e-9882-a80368641bac => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:38.301839 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-61986754-ee9f-4479-b83c-215523b5e68f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:38.310134 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-61986754-ee9f-4479-b83c-215523b5e68f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1735 microversion: 2.1 time: 0.153384 Jun 08 02:09:38.310693 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 266/517] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:38 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:09:39.189672 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5926bc1d-f2df-4ba5-913c-68dbc3833e26 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:39.190350 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5926bc1d-f2df-4ba5-913c-68dbc3833e26 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: 3cc699b5-d7f5-466e-9882-a80368641bac] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:39.192135 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:09:39.192972 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=8 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:09:39.199269 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5926bc1d-f2df-4ba5-913c-68dbc3833e26 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:39.199711 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5926bc1d-f2df-4ba5-913c-68dbc3833e26 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:39.200495 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5926bc1d-f2df-4ba5-913c-68dbc3833e26 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:39.200924 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5926bc1d-f2df-4ba5-913c-68dbc3833e26 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:39.326818 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5926bc1d-f2df-4ba5-913c-68dbc3833e26 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:39.326998 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-baa1e91a-1591-4be1-924c-45e9125ff5a9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:39.327581 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-baa1e91a-1591-4be1-924c-45e9125ff5a9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:39.334153 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-baa1e91a-1591-4be1-924c-45e9125ff5a9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:39.334594 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-baa1e91a-1591-4be1-924c-45e9125ff5a9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:39.334713 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5926bc1d-f2df-4ba5-913c-68dbc3833e26 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/3cc699b5-d7f5-466e-9882-a80368641bac" status: 200 len: 1319 microversion: 2.1 time: 0.148959 Jun 08 02:09:39.335252 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 252/518] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:39 2022] GET /compute/v2.1/servers/3cc699b5-d7f5-466e-9882-a80368641bac => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:39.335460 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-baa1e91a-1591-4be1-924c-45e9125ff5a9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:39.336277 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-baa1e91a-1591-4be1-924c-45e9125ff5a9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:39.468127 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-baa1e91a-1591-4be1-924c-45e9125ff5a9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:39.476104 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-baa1e91a-1591-4be1-924c-45e9125ff5a9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1735 microversion: 2.1 time: 0.153011 Jun 08 02:09:39.477058 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 267/519] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:39 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:09:40.351939 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2780e8fc-0916-48ed-821d-1647471d76fc tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:40.352615 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2780e8fc-0916-48ed-821d-1647471d76fc tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: 3cc699b5-d7f5-466e-9882-a80368641bac] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:40.359083 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2780e8fc-0916-48ed-821d-1647471d76fc tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:40.359529 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2780e8fc-0916-48ed-821d-1647471d76fc tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:40.360289 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2780e8fc-0916-48ed-821d-1647471d76fc tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:40.360757 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2780e8fc-0916-48ed-821d-1647471d76fc tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:40.493838 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-74100641-ff98-4212-8f92-34f3bcfb34b5 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:40.494453 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-74100641-ff98-4212-8f92-34f3bcfb34b5 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:40.495861 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2780e8fc-0916-48ed-821d-1647471d76fc tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:40.501104 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-74100641-ff98-4212-8f92-34f3bcfb34b5 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:40.501545 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-74100641-ff98-4212-8f92-34f3bcfb34b5 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:40.502313 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-74100641-ff98-4212-8f92-34f3bcfb34b5 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:40.502748 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-74100641-ff98-4212-8f92-34f3bcfb34b5 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:40.503383 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2780e8fc-0916-48ed-821d-1647471d76fc tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/3cc699b5-d7f5-466e-9882-a80368641bac" status: 200 len: 1508 microversion: 2.1 time: 0.156022 Jun 08 02:09:40.503948 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 253/520] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:40 2022] GET /compute/v2.1/servers/3cc699b5-d7f5-466e-9882-a80368641bac => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:40.519333 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1f71df57-e81d-4b68-bcbe-f88f359ced41 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0158e11b-3e17-41af-8774-3f295e7d4a1a", "device": "/dev/sdb"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:09:40.520950 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-1f71df57-e81d-4b68-bcbe-f88f359ced41 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: 3cc699b5-d7f5-466e-9882-a80368641bac] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:40.527729 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1f71df57-e81d-4b68-bcbe-f88f359ced41 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:40.528183 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1f71df57-e81d-4b68-bcbe-f88f359ced41 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:40.529000 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1f71df57-e81d-4b68-bcbe-f88f359ced41 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:40.529434 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1f71df57-e81d-4b68-bcbe-f88f359ced41 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:40.633681 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-74100641-ff98-4212-8f92-34f3bcfb34b5 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:40.641821 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-74100641-ff98-4212-8f92-34f3bcfb34b5 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1735 microversion: 2.1 time: 0.152386 Jun 08 02:09:40.642420 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 268/521] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:40 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:09:40.656257 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:09:40.769726 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1f71df57-e81d-4b68-bcbe-f88f359ced41 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "POST /compute/v2.1/servers/3cc699b5-d7f5-466e-9882-a80368641bac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254025 Jun 08 02:09:40.770409 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 254/522] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jun 8 02:09:40 2022] POST /compute/v2.1/servers/3cc699b5-d7f5-466e-9882-a80368641bac/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 02:09:41.659779 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e02113f7-e789-432f-a26e-58f370a336ac tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:41.660320 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e02113f7-e789-432f-a26e-58f370a336ac tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:41.666988 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e02113f7-e789-432f-a26e-58f370a336ac tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:41.667428 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e02113f7-e789-432f-a26e-58f370a336ac tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:41.668178 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e02113f7-e789-432f-a26e-58f370a336ac tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:41.668636 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e02113f7-e789-432f-a26e-58f370a336ac tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:41.801060 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e02113f7-e789-432f-a26e-58f370a336ac tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:41.809093 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e02113f7-e789-432f-a26e-58f370a336ac tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1735 microversion: 2.1 time: 0.153508 Jun 08 02:09:41.809663 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 269/523] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:41 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:42.827407 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-48474928-e2a2-4bf7-9e16-38ea9d284f6f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:42.828094 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-48474928-e2a2-4bf7-9e16-38ea9d284f6f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:42.834284 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-48474928-e2a2-4bf7-9e16-38ea9d284f6f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:42.834730 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-48474928-e2a2-4bf7-9e16-38ea9d284f6f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:42.835484 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-48474928-e2a2-4bf7-9e16-38ea9d284f6f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:42.835947 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-48474928-e2a2-4bf7-9e16-38ea9d284f6f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:42.965566 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-48474928-e2a2-4bf7-9e16-38ea9d284f6f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:42.973465 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-48474928-e2a2-4bf7-9e16-38ea9d284f6f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1735 microversion: 2.1 time: 0.150917 Jun 08 02:09:42.974024 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 255/524] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:42 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:43.990614 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f799b6ef-d932-4f7e-b12a-bc4fe810b0ee tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:43.991251 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f799b6ef-d932-4f7e-b12a-bc4fe810b0ee tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:43.998368 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f799b6ef-d932-4f7e-b12a-bc4fe810b0ee tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:43.998810 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f799b6ef-d932-4f7e-b12a-bc4fe810b0ee tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:43.999569 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f799b6ef-d932-4f7e-b12a-bc4fe810b0ee tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:44.000000 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f799b6ef-d932-4f7e-b12a-bc4fe810b0ee tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:44.131167 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f799b6ef-d932-4f7e-b12a-bc4fe810b0ee tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:44.139075 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f799b6ef-d932-4f7e-b12a-bc4fe810b0ee tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1735 microversion: 2.1 time: 0.152259 Jun 08 02:09:44.139641 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 270/525] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:43 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:45.156050 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-78207cb3-f6f6-4edb-9f1c-ac10125c6c46 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:45.156667 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-78207cb3-f6f6-4edb-9f1c-ac10125c6c46 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:45.163370 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-78207cb3-f6f6-4edb-9f1c-ac10125c6c46 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:45.163811 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-78207cb3-f6f6-4edb-9f1c-ac10125c6c46 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:45.165452 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-78207cb3-f6f6-4edb-9f1c-ac10125c6c46 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:45.165859 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-78207cb3-f6f6-4edb-9f1c-ac10125c6c46 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:45.295231 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-78207cb3-f6f6-4edb-9f1c-ac10125c6c46 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:45.303169 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-78207cb3-f6f6-4edb-9f1c-ac10125c6c46 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1735 microversion: 2.1 time: 0.150970 Jun 08 02:09:45.303734 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 256/526] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:45 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:46.321372 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-fa4980ee-b36f-474b-ac6d-b838ca812666 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:46.322026 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-fa4980ee-b36f-474b-ac6d-b838ca812666 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:46.328353 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fa4980ee-b36f-474b-ac6d-b838ca812666 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:46.328823 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fa4980ee-b36f-474b-ac6d-b838ca812666 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:46.329570 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fa4980ee-b36f-474b-ac6d-b838ca812666 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:46.329998 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fa4980ee-b36f-474b-ac6d-b838ca812666 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:46.457364 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-fa4980ee-b36f-474b-ac6d-b838ca812666 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:46.465281 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-fa4980ee-b36f-474b-ac6d-b838ca812666 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1735 microversion: 2.1 time: 0.148411 Jun 08 02:09:46.465841 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 271/527] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:46 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:47.481974 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b0a1297c-482b-4080-81eb-77c90231cdf9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:47.482581 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b0a1297c-482b-4080-81eb-77c90231cdf9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:47.489104 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b0a1297c-482b-4080-81eb-77c90231cdf9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:47.489555 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b0a1297c-482b-4080-81eb-77c90231cdf9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:47.490311 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b0a1297c-482b-4080-81eb-77c90231cdf9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:47.490747 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b0a1297c-482b-4080-81eb-77c90231cdf9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:47.629246 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b0a1297c-482b-4080-81eb-77c90231cdf9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:47.638613 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b0a1297c-482b-4080-81eb-77c90231cdf9 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1715 microversion: 2.1 time: 0.160451 Jun 08 02:09:47.640966 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 257/528] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:47 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1715 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:47.749184 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-20c79942-3ec1-45f2-a898-893a181dd0b6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:47.749721 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-20c79942-3ec1-45f2-a898-893a181dd0b6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:47.756272 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-20c79942-3ec1-45f2-a898-893a181dd0b6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:47.756758 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-20c79942-3ec1-45f2-a898-893a181dd0b6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:47.757516 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-20c79942-3ec1-45f2-a898-893a181dd0b6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:47.758103 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-20c79942-3ec1-45f2-a898-893a181dd0b6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:47.836763 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-20c79942-3ec1-45f2-a898-893a181dd0b6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] HTTP exception thrown: Cannot 'detach_volume' instance 596fe635-9554-4305-b88e-67139f06a3d0 while it is in vm_state rescued Jun 08 02:09:47.838362 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-20c79942-3ec1-45f2-a898-893a181dd0b6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Request method failure captured: Jun 08 02:09:47.838362 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: request: DELETE /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0/os-volume_attachments/2f8b7c34-6efc-40b5-8c74-72b4032f835d HTTP/1.1 Jun 08 02:09:47.838362 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept: application/json Jun 08 02:09:47.838362 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jun 08 02:09:47.838362 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Connection: close Jun 08 02:09:47.838362 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jun 08 02:09:47.838362 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jun 08 02:09:47.838362 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Host: 10.222.0.20 Jun 08 02:09:47.838362 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jun 08 02:09:47.838362 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jun 08 02:09:47.838362 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABioAPv8gMotrJlZTFwglagYqckJEX1fLvg2vCOIJVfZx23pLMKwu0kMosHU2TJEE42L3PHJCygQBsaqUei7q2GmAE1OvpdyyA2K6f4U-qDG0gFChJCyiiFe6KgYhekG7cdzFKfmztAXfzdnIapCZ5hWCdvq58rcVhDFHy9z0kDGo3H5gg Jun 08 02:09:47.838362 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jun 08 02:09:47.838362 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jun 08 02:09:47.838362 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jun 08 02:09:47.838362 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jun 08 02:09:47.838362 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jun 08 02:09:47.838362 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jun 08 02:09:47.838362 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Id: d40d753f66ec4ed2808aa65b825e66f8 Jun 08 02:09:47.838362 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-237519543 Jun 08 02:09:47.838362 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jun 08 02:09:47.838362 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jun 08 02:09:47.839941 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d40d753f66ec4ed2808aa65b825e66f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d40d753f66ec4ed2808aa65b825e66f8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d40d753f66ec4ed2808aa65b825e66f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d40d753f66ec4ed2808aa65b825e66f8"}]}] Jun 08 02:09:47.839941 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-ServerRescueNegativeTestJSON-237519543 Jun 08 02:09:47.839941 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Id: d40d753f66ec4ed2808aa65b825e66f8 Jun 08 02:09:47.839941 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-237519543 Jun 08 02:09:47.839941 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User: tempest-ServerRescueNegativeTestJSON-237519543-project Jun 08 02:09:47.839941 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jun 08 02:09:47.839941 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jun 08 02:09:47.839941 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Id: 9e13bd970d2e4d67b62452ae0d6cae56 Jun 08 02:09:47.839941 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-ServerRescueNegativeTestJSON-237519543-project Jun 08 02:09:47.839941 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: method: > Jun 08 02:09:47.839941 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: exception: Cannot 'detach_volume' instance 596fe635-9554-4305-b88e-67139f06a3d0 while it is in vm_state rescued Jun 08 02:09:47.840790 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: action_args: {'server_id': '596fe635-9554-4305-b88e-67139f06a3d0', 'id': '2f8b7c34-6efc-40b5-8c74-72b4032f835d'} Jun 08 02:09:47.840790 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:09:47.840790 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:09:47.840790 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 08 02:09:47.840790 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 08 02:09:47.840790 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 08 02:09:47.840790 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 08 02:09:47.840790 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 08 02:09:47.840790 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 08 02:09:47.840790 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 596fe635-9554-4305-b88e-67139f06a3d0 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 08 02:09:47.840790 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:09:47.840790 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:09:47.840790 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:09:47.840790 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:09:47.840790 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:09:47.840790 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:09:47.840790 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:09:47.840790 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:09:47.840790 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:09:47.840790 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:09:47.842257 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 08 02:09:47.842257 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 08 02:09:47.842257 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 08 02:09:47.842257 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 08 02:09:47.842257 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 596fe635-9554-4305-b88e-67139f06a3d0 while it is in vm_state rescued Jun 08 02:09:47.842257 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:09:47.842257 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:09:47.842257 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:09:47.842257 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:09:47.842257 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:09:47.842257 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:09:47.842257 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:09:47.842257 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:09:47.842257 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 596fe635-9554-4305-b88e-67139f06a3d0 while it is in vm_state rescued Jun 08 02:09:47.842257 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:09:47.842257 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-20c79942-3ec1-45f2-a898-893a181dd0b6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Returning 409 to user: Cannot 'detach_volume' instance 596fe635-9554-4305-b88e-67139f06a3d0 while it is in vm_state rescued {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:09:47.843468 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-20c79942-3ec1-45f2-a898-893a181dd0b6 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "DELETE /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0/os-volume_attachments/2f8b7c34-6efc-40b5-8c74-72b4032f835d" status: 409 len: 152 microversion: 2.1 time: 0.094734 Jun 08 02:09:47.843468 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 272/529] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jun 8 02:09:47 2022] DELETE /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0/os-volume_attachments/2f8b7c34-6efc-40b5-8c74-72b4032f835d => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 08 02:09:47.848681 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0aa90107-d3fa-49f2-bf3f-11aea4c5111f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:09:47.849208 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0aa90107-d3fa-49f2-bf3f-11aea4c5111f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:47.856195 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0aa90107-d3fa-49f2-bf3f-11aea4c5111f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:47.856669 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0aa90107-d3fa-49f2-bf3f-11aea4c5111f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:47.857411 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0aa90107-d3fa-49f2-bf3f-11aea4c5111f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:47.857839 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0aa90107-d3fa-49f2-bf3f-11aea4c5111f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:47.924058 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0aa90107-d3fa-49f2-bf3f-11aea4c5111f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "POST /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0/action" status: 202 len: 0 microversion: 2.1 time: 0.079040 Jun 08 02:09:47.924887 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 258/530] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jun 8 02:09:47 2022] POST /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 02:09:47.932891 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-acdbc93a-a2b6-476f-bea3-d1fcaf29af5f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:47.933501 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-acdbc93a-a2b6-476f-bea3-d1fcaf29af5f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:47.940995 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-acdbc93a-a2b6-476f-bea3-d1fcaf29af5f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:47.941603 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-acdbc93a-a2b6-476f-bea3-d1fcaf29af5f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:47.942374 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-acdbc93a-a2b6-476f-bea3-d1fcaf29af5f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:47.942808 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-acdbc93a-a2b6-476f-bea3-d1fcaf29af5f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:48.163274 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-acdbc93a-a2b6-476f-bea3-d1fcaf29af5f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:48.174030 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-acdbc93a-a2b6-476f-bea3-d1fcaf29af5f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1723 microversion: 2.1 time: 0.244923 Jun 08 02:09:48.175164 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 273/531] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:47 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:49.191676 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-02037e6f-19d9-4337-8601-3ef62c4ece65 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:49.192303 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-02037e6f-19d9-4337-8601-3ef62c4ece65 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:49.200032 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-02037e6f-19d9-4337-8601-3ef62c4ece65 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:49.200679 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-02037e6f-19d9-4337-8601-3ef62c4ece65 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:49.201431 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-02037e6f-19d9-4337-8601-3ef62c4ece65 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:49.201890 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-02037e6f-19d9-4337-8601-3ef62c4ece65 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:49.328609 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-02037e6f-19d9-4337-8601-3ef62c4ece65 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:49.337809 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-02037e6f-19d9-4337-8601-3ef62c4ece65 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1723 microversion: 2.1 time: 0.150407 Jun 08 02:09:49.338371 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 259/532] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:49 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:50.355677 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-cbf82851-1abb-443d-a531-0a96b37f48ea tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:50.356280 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-cbf82851-1abb-443d-a531-0a96b37f48ea tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:50.362729 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cbf82851-1abb-443d-a531-0a96b37f48ea tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:50.363176 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cbf82851-1abb-443d-a531-0a96b37f48ea tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:50.363932 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cbf82851-1abb-443d-a531-0a96b37f48ea tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:50.364360 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cbf82851-1abb-443d-a531-0a96b37f48ea tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:50.491573 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-cbf82851-1abb-443d-a531-0a96b37f48ea tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:50.500076 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-cbf82851-1abb-443d-a531-0a96b37f48ea tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1723 microversion: 2.1 time: 0.148999 Jun 08 02:09:50.500665 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 274/533] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:50 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:51.518355 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-99f638f2-9b8d-41e6-a7c9-c0768095aad3 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:51.518956 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-99f638f2-9b8d-41e6-a7c9-c0768095aad3 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:51.526117 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-99f638f2-9b8d-41e6-a7c9-c0768095aad3 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:51.526558 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-99f638f2-9b8d-41e6-a7c9-c0768095aad3 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:51.527310 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-99f638f2-9b8d-41e6-a7c9-c0768095aad3 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:51.527738 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-99f638f2-9b8d-41e6-a7c9-c0768095aad3 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:51.655148 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-99f638f2-9b8d-41e6-a7c9-c0768095aad3 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:51.663380 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-99f638f2-9b8d-41e6-a7c9-c0768095aad3 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1723 microversion: 2.1 time: 0.149621 Jun 08 02:09:51.664099 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 260/534] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:51 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:52.680754 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-bb7eedcf-6753-4ef9-8946-f7968586ab30 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:52.681421 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-bb7eedcf-6753-4ef9-8946-f7968586ab30 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:52.683826 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=62 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:09:52.689120 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bb7eedcf-6753-4ef9-8946-f7968586ab30 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:52.689573 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bb7eedcf-6753-4ef9-8946-f7968586ab30 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:52.690337 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bb7eedcf-6753-4ef9-8946-f7968586ab30 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:52.690772 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bb7eedcf-6753-4ef9-8946-f7968586ab30 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:52.823307 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-bb7eedcf-6753-4ef9-8946-f7968586ab30 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:52.831175 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-bb7eedcf-6753-4ef9-8946-f7968586ab30 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1723 microversion: 2.1 time: 0.154551 Jun 08 02:09:52.832000 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 275/535] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:52 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:53.849655 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-bbdd1c1c-b51c-4b98-94cc-0076e0b3c211 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:53.850260 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-bbdd1c1c-b51c-4b98-94cc-0076e0b3c211 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:53.859262 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bbdd1c1c-b51c-4b98-94cc-0076e0b3c211 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:53.859706 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bbdd1c1c-b51c-4b98-94cc-0076e0b3c211 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:53.860505 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bbdd1c1c-b51c-4b98-94cc-0076e0b3c211 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:53.860948 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bbdd1c1c-b51c-4b98-94cc-0076e0b3c211 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:53.997170 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-bbdd1c1c-b51c-4b98-94cc-0076e0b3c211 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:54.005528 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-bbdd1c1c-b51c-4b98-94cc-0076e0b3c211 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1723 microversion: 2.1 time: 0.160309 Jun 08 02:09:54.006119 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 261/536] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:53 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:55.021878 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-315ec7b4-db9a-4c25-887f-a554d3029cf3 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:55.022478 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-315ec7b4-db9a-4c25-887f-a554d3029cf3 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:55.029483 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-315ec7b4-db9a-4c25-887f-a554d3029cf3 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:55.029925 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-315ec7b4-db9a-4c25-887f-a554d3029cf3 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:55.030671 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-315ec7b4-db9a-4c25-887f-a554d3029cf3 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:55.031097 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-315ec7b4-db9a-4c25-887f-a554d3029cf3 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:55.158329 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-315ec7b4-db9a-4c25-887f-a554d3029cf3 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:55.166589 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-315ec7b4-db9a-4c25-887f-a554d3029cf3 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1723 microversion: 2.1 time: 0.148485 Jun 08 02:09:55.167079 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 276/537] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:55 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:56.184028 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7648bd38-bcf3-4647-b64c-2cee00a8cbcc tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:56.184585 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7648bd38-bcf3-4647-b64c-2cee00a8cbcc tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:56.186974 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:09:56.192322 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7648bd38-bcf3-4647-b64c-2cee00a8cbcc tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:56.192791 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7648bd38-bcf3-4647-b64c-2cee00a8cbcc tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:56.193563 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7648bd38-bcf3-4647-b64c-2cee00a8cbcc tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:56.193991 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7648bd38-bcf3-4647-b64c-2cee00a8cbcc tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:56.322646 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7648bd38-bcf3-4647-b64c-2cee00a8cbcc tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:56.330466 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7648bd38-bcf3-4647-b64c-2cee00a8cbcc tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1723 microversion: 2.1 time: 0.150915 Jun 08 02:09:56.331019 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 262/538] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:56 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:57.347467 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-8bee7afb-2de4-4016-a2ce-011055dc432f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:57.348076 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-8bee7afb-2de4-4016-a2ce-011055dc432f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:57.355279 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8bee7afb-2de4-4016-a2ce-011055dc432f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:57.355729 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8bee7afb-2de4-4016-a2ce-011055dc432f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:57.356516 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8bee7afb-2de4-4016-a2ce-011055dc432f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:57.356971 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8bee7afb-2de4-4016-a2ce-011055dc432f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:57.484490 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-8bee7afb-2de4-4016-a2ce-011055dc432f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:09:57.492314 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-8bee7afb-2de4-4016-a2ce-011055dc432f tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1729 microversion: 2.1 time: 0.148725 Jun 08 02:09:57.492930 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 277/539] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:09:57 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:09:57.509445 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-045cbde1-4d00-40f4-90a2-47375b1332c7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:09:57.509942 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-045cbde1-4d00-40f4-90a2-47375b1332c7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:09:57.516318 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-045cbde1-4d00-40f4-90a2-47375b1332c7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:57.516791 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-045cbde1-4d00-40f4-90a2-47375b1332c7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:57.517537 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-045cbde1-4d00-40f4-90a2-47375b1332c7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:57.517966 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-045cbde1-4d00-40f4-90a2-47375b1332c7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:57.594952 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-045cbde1-4d00-40f4-90a2-47375b1332c7 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090236 Jun 08 02:09:57.595548 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 263/540] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jun 8 02:09:57 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:09:58.454809 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-21abd8c6-d9da-4c6d-961b-a8060667e54a req-343fbefc-4e78-4d1a-9bb6-707176e39236 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "596fe635-9554-4305-b88e-67139f06a3d0", "tag": "d96f59a2-4ec1-4327-b308-e50814a9bbc5"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:09:58.465015 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-21abd8c6-d9da-4c6d-961b-a8060667e54a req-343fbefc-4e78-4d1a-9bb6-707176e39236 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:09:58.465535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-21abd8c6-d9da-4c6d-961b-a8060667e54a req-343fbefc-4e78-4d1a-9bb6-707176e39236 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:09:58.477382 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-21abd8c6-d9da-4c6d-961b-a8060667e54a req-343fbefc-4e78-4d1a-9bb6-707176e39236 service nova] Creating event network-changed:d96f59a2-4ec1-4327-b308-e50814a9bbc5 for instance 596fe635-9554-4305-b88e-67139f06a3d0 on hv-cinder-84506 Jun 08 02:09:58.485414 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-21abd8c6-d9da-4c6d-961b-a8060667e54a req-343fbefc-4e78-4d1a-9bb6-707176e39236 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034666 Jun 08 02:09:58.486089 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 278/541] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:10:00.085039 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f4961fa5-7e3a-4709-a595-aeb0d13b696d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:00.086444 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f4961fa5-7e3a-4709-a595-aeb0d13b696d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: 3cc699b5-d7f5-466e-9882-a80368641bac] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:00.091981 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f4961fa5-7e3a-4709-a595-aeb0d13b696d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:00.092446 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f4961fa5-7e3a-4709-a595-aeb0d13b696d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:00.093195 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f4961fa5-7e3a-4709-a595-aeb0d13b696d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:00.093624 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f4961fa5-7e3a-4709-a595-aeb0d13b696d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:00.221039 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-f4961fa5-7e3a-4709-a595-aeb0d13b696d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lazy-loading 'services' on Instance uuid 3cc699b5-d7f5-466e-9882-a80368641bac {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 02:10:00.347236 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f4961fa5-7e3a-4709-a595-aeb0d13b696d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3cc699b5-d7f5-466e-9882-a80368641bac/os-volume_attachments/0158e11b-3e17-41af-8774-3f295e7d4a1a" status: 202 len: 0 microversion: 2.1 time: 0.266572 Jun 08 02:10:00.347878 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 264/542] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jun 8 02:10:00 2022] DELETE /compute/v2.1/servers/3cc699b5-d7f5-466e-9882-a80368641bac/os-volume_attachments/0158e11b-3e17-41af-8774-3f295e7d4a1a => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 02:10:00.500442 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-cc00a0db-ac84-4366-894a-85e10b0e7c12 req-2e10958e-d335-4508-b2e2-5a6a1fa96c47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "596fe635-9554-4305-b88e-67139f06a3d0", "tag": "d96f59a2-4ec1-4327-b308-e50814a9bbc5"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:10:00.509615 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-cc00a0db-ac84-4366-894a-85e10b0e7c12 req-2e10958e-d335-4508-b2e2-5a6a1fa96c47 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:00.510054 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-cc00a0db-ac84-4366-894a-85e10b0e7c12 req-2e10958e-d335-4508-b2e2-5a6a1fa96c47 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:00.520340 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-cc00a0db-ac84-4366-894a-85e10b0e7c12 req-2e10958e-d335-4508-b2e2-5a6a1fa96c47 service nova] Creating event network-changed:d96f59a2-4ec1-4327-b308-e50814a9bbc5 for instance 596fe635-9554-4305-b88e-67139f06a3d0 on hv-cinder-84506 Jun 08 02:10:00.525654 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-cc00a0db-ac84-4366-894a-85e10b0e7c12 req-2e10958e-d335-4508-b2e2-5a6a1fa96c47 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029191 Jun 08 02:10:00.526208 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 279/543] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:10:01.461317 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e4d834a7-8572-4f04-bfc3-449f292ac558 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:01.462411 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e4d834a7-8572-4f04-bfc3-449f292ac558 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: 3cc699b5-d7f5-466e-9882-a80368641bac] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:01.468870 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e4d834a7-8572-4f04-bfc3-449f292ac558 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:01.469317 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e4d834a7-8572-4f04-bfc3-449f292ac558 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:01.470081 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e4d834a7-8572-4f04-bfc3-449f292ac558 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:01.470519 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e4d834a7-8572-4f04-bfc3-449f292ac558 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:01.495758 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e4d834a7-8572-4f04-bfc3-449f292ac558 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: 3cc699b5-d7f5-466e-9882-a80368641bac] Going to try to terminate instance {{(pid=117938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 02:10:01.568258 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e4d834a7-8572-4f04-bfc3-449f292ac558 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3cc699b5-d7f5-466e-9882-a80368641bac" status: 204 len: 0 microversion: 2.1 time: 0.111548 Jun 08 02:10:01.568892 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 265/544] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jun 8 02:10:01 2022] DELETE /compute/v2.1/servers/3cc699b5-d7f5-466e-9882-a80368641bac => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 08 02:10:01.578652 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e27876af-c393-41a0-a20e-28fb3780a63a tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:01.579351 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e27876af-c393-41a0-a20e-28fb3780a63a tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: 3cc699b5-d7f5-466e-9882-a80368641bac] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:01.585553 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e27876af-c393-41a0-a20e-28fb3780a63a tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:01.586004 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e27876af-c393-41a0-a20e-28fb3780a63a tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:01.586764 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e27876af-c393-41a0-a20e-28fb3780a63a tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:01.587750 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e27876af-c393-41a0-a20e-28fb3780a63a tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:01.602157 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=100 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:10:01.718301 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e27876af-c393-41a0-a20e-28fb3780a63a tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:01.725950 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e27876af-c393-41a0-a20e-28fb3780a63a tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/3cc699b5-d7f5-466e-9882-a80368641bac" status: 200 len: 1514 microversion: 2.1 time: 0.152154 Jun 08 02:10:01.726577 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 280/545] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:10:01 2022] GET /compute/v2.1/servers/3cc699b5-d7f5-466e-9882-a80368641bac => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:10:02.744405 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8038b217-24bd-404e-a2d5-ca910028d652 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:02.745112 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8038b217-24bd-404e-a2d5-ca910028d652 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: 3cc699b5-d7f5-466e-9882-a80368641bac] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:02.751855 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8038b217-24bd-404e-a2d5-ca910028d652 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:02.752361 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8038b217-24bd-404e-a2d5-ca910028d652 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:02.753295 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8038b217-24bd-404e-a2d5-ca910028d652 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:02.753732 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8038b217-24bd-404e-a2d5-ca910028d652 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:02.885586 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8038b217-24bd-404e-a2d5-ca910028d652 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:02.893031 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8038b217-24bd-404e-a2d5-ca910028d652 tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/3cc699b5-d7f5-466e-9882-a80368641bac" status: 200 len: 1514 microversion: 2.1 time: 0.152906 Jun 08 02:10:02.893589 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 266/546] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:10:02 2022] GET /compute/v2.1/servers/3cc699b5-d7f5-466e-9882-a80368641bac => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:10:03.910390 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0dc97546-77c1-43e3-9d72-7206fe67c04e tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:03.911005 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-0dc97546-77c1-43e3-9d72-7206fe67c04e tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: 3cc699b5-d7f5-466e-9882-a80368641bac] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:03.918287 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0dc97546-77c1-43e3-9d72-7206fe67c04e tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:03.918738 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0dc97546-77c1-43e3-9d72-7206fe67c04e tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:03.919518 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0dc97546-77c1-43e3-9d72-7206fe67c04e tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:03.919955 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0dc97546-77c1-43e3-9d72-7206fe67c04e tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:04.147514 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-0dc97546-77c1-43e3-9d72-7206fe67c04e tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9556a3adc6b40ee93c498fb98cd77ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd7ed883a04e91b36482a8950b12d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:04.155071 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-0dc97546-77c1-43e3-9d72-7206fe67c04e tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/3cc699b5-d7f5-466e-9882-a80368641bac" status: 200 len: 1514 microversion: 2.1 time: 0.248858 Jun 08 02:10:04.155647 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 281/547] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:10:03 2022] GET /compute/v2.1/servers/3cc699b5-d7f5-466e-9882-a80368641bac => generated 1514 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:10:04.375624 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-6ca4cb6b-1420-45a0-a030-eb08166ea345 req-ea361c1e-c2da-44dd-87f3-1ff2146e1bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc699b5-d7f5-466e-9882-a80368641bac", "name": "network-vif-deleted", "tag": "46f78d55-b541-47ea-88b7-8af0f92f361f"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:10:04.384727 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-6ca4cb6b-1420-45a0-a030-eb08166ea345 req-ea361c1e-c2da-44dd-87f3-1ff2146e1bb1 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:04.385194 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-6ca4cb6b-1420-45a0-a030-eb08166ea345 req-ea361c1e-c2da-44dd-87f3-1ff2146e1bb1 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:04.396294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-6ca4cb6b-1420-45a0-a030-eb08166ea345 req-ea361c1e-c2da-44dd-87f3-1ff2146e1bb1 service nova] Creating event network-vif-deleted:46f78d55-b541-47ea-88b7-8af0f92f361f for instance 3cc699b5-d7f5-466e-9882-a80368641bac on hv-cinder-84506 Jun 08 02:10:04.402158 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-6ca4cb6b-1420-45a0-a030-eb08166ea345 req-ea361c1e-c2da-44dd-87f3-1ff2146e1bb1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030189 Jun 08 02:10:04.402751 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 267/548] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:10:05.173216 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d20d5b9f-d523-40b4-8c32-06f72ee3038d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:05.173760 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d20d5b9f-d523-40b4-8c32-06f72ee3038d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] [instance: 3cc699b5-d7f5-466e-9882-a80368641bac] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:05.180113 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d20d5b9f-d523-40b4-8c32-06f72ee3038d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:05.181329 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d20d5b9f-d523-40b4-8c32-06f72ee3038d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:05.182618 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d20d5b9f-d523-40b4-8c32-06f72ee3038d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:05.183379 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d20d5b9f-d523-40b4-8c32-06f72ee3038d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:05.197059 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-d20d5b9f-d523-40b4-8c32-06f72ee3038d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] HTTP exception thrown: Instance 3cc699b5-d7f5-466e-9882-a80368641bac could not be found. Jun 08 02:10:05.198664 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d20d5b9f-d523-40b4-8c32-06f72ee3038d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Request method failure captured: Jun 08 02:10:05.198664 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/3cc699b5-d7f5-466e-9882-a80368641bac HTTP/1.1 Jun 08 02:10:05.198664 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept: application/json Jun 08 02:10:05.198664 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jun 08 02:10:05.198664 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Connection: close Jun 08 02:10:05.198664 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jun 08 02:10:05.198664 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jun 08 02:10:05.198664 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Host: 10.222.0.20 Jun 08 02:10:05.198664 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jun 08 02:10:05.198664 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jun 08 02:10:05.198664 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABioARuApmH_DyDVaVlq4lg3fzECGd01AdMgqOWvXc4Bx5LVJsVnTe6f8TlK2Do0UzUt-5hzb2aGY27PH8wDwYdcPD8iwfZOdWZYlKW3cj1VTBF_-FXZ37NX9v18kIq-gFl0V9XTy4TiryKVgnRyvmIv035rA6S_GcH0v-RWjBTLsR6O-8 Jun 08 02:10:05.198664 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jun 08 02:10:05.198664 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jun 08 02:10:05.198664 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jun 08 02:10:05.198664 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jun 08 02:10:05.198664 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jun 08 02:10:05.198664 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jun 08 02:10:05.198664 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Id: 68cd7ed883a04e91b36482a8950b12d1 Jun 08 02:10:05.198664 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1139519056 Jun 08 02:10:05.198664 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jun 08 02:10:05.198664 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jun 08 02:10:05.200177 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68cd7ed883a04e91b36482a8950b12d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_68cd7ed883a04e91b36482a8950b12d1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/68cd7ed883a04e91b36482a8950b12d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68cd7ed883a04e91b36482a8950b12d1"}]}] Jun 08 02:10:05.200177 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-VolumesSnapshotTestJSON-1139519056 Jun 08 02:10:05.200177 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 68cd7ed883a04e91b36482a8950b12d1 Jun 08 02:10:05.200177 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1139519056 Jun 08 02:10:05.200177 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User: tempest-VolumesSnapshotTestJSON-1139519056-project Jun 08 02:10:05.200177 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jun 08 02:10:05.200177 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jun 08 02:10:05.200177 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Id: f9556a3adc6b40ee93c498fb98cd77ea Jun 08 02:10:05.200177 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-VolumesSnapshotTestJSON-1139519056-project Jun 08 02:10:05.200177 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: method: > Jun 08 02:10:05.200177 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: exception: Instance 3cc699b5-d7f5-466e-9882-a80368641bac could not be found. Jun 08 02:10:05.200177 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: action_args: {'id': '3cc699b5-d7f5-466e-9882-a80368641bac'} Jun 08 02:10:05.201206 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:10:05.201206 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:10:05.201206 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:10:05.201206 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:10:05.201206 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:10:05.201206 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:10:05.201206 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:10:05.201206 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:10:05.201206 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:10:05.201206 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:10:05.201206 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cc699b5-d7f5-466e-9882-a80368641bac could not be found. Jun 08 02:10:05.201206 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:10:05.201206 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:10:05.201206 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:10:05.201206 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:10:05.201206 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:10:05.201206 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:10:05.201206 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:10:05.201206 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:10:05.201206 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:10:05.202654 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:10:05.202654 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 02:10:05.202654 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 02:10:05.202654 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:10:05.202654 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:10:05.202654 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:10:05.202654 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:10:05.202654 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cc699b5-d7f5-466e-9882-a80368641bac could not be found. Jun 08 02:10:05.202654 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:10:05.202654 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:10:05.202654 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:10:05.202654 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:10:05.202654 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:10:05.202654 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:10:05.202654 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:10:05.202654 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:10:05.202654 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cc699b5-d7f5-466e-9882-a80368641bac could not be found. Jun 08 02:10:05.202654 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:10:05.203976 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d20d5b9f-d523-40b4-8c32-06f72ee3038d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] Returning 404 to user: Instance 3cc699b5-d7f5-466e-9882-a80368641bac could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:10:05.203976 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d20d5b9f-d523-40b4-8c32-06f72ee3038d tempest-VolumesSnapshotTestJSON-1139519056 tempest-VolumesSnapshotTestJSON-1139519056-project] 10.222.0.20 "GET /compute/v2.1/servers/3cc699b5-d7f5-466e-9882-a80368641bac" status: 404 len: 111 microversion: 2.1 time: 0.030712 Jun 08 02:10:05.203976 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 282/549] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:10:05 2022] GET /compute/v2.1/servers/3cc699b5-d7f5-466e-9882-a80368641bac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 02:10:10.595326 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ac9a8dd3-01bb-4c75-ba0e-4065fbae66e9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:10.595866 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ac9a8dd3-01bb-4c75-ba0e-4065fbae66e9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:10.602040 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ac9a8dd3-01bb-4c75-ba0e-4065fbae66e9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:10.602480 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ac9a8dd3-01bb-4c75-ba0e-4065fbae66e9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:10.603402 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ac9a8dd3-01bb-4c75-ba0e-4065fbae66e9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:10.603837 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ac9a8dd3-01bb-4c75-ba0e-4065fbae66e9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:10.607451 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=92,nova_cell1:INSERT=4 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:10:10.634517 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ac9a8dd3-01bb-4c75-ba0e-4065fbae66e9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56/os-volume_attachments/c47ed588-2d09-496b-91e6-c5803d3cc250" status: 200 len: 194 microversion: 2.20 time: 0.044317 Jun 08 02:10:10.635092 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 268/550] 10.222.0.20 () {60 vars in 1453 bytes} [Wed Jun 8 02:10:10 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56/os-volume_attachments/c47ed588-2d09-496b-91e6-c5803d3cc250 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 08 02:10:10.697192 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-de2d3e41-77b4-4869-8858-785ec8fb950a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:10.697680 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-de2d3e41-77b4-4869-8858-785ec8fb950a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:10.703864 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-de2d3e41-77b4-4869-8858-785ec8fb950a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:10.704340 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-de2d3e41-77b4-4869-8858-785ec8fb950a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:10.705128 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-de2d3e41-77b4-4869-8858-785ec8fb950a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:10.705559 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-de2d3e41-77b4-4869-8858-785ec8fb950a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:10.787534 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.objects.instance [None req-de2d3e41-77b4-4869-8858-785ec8fb950a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lazy-loading 'services' on Instance uuid b7944f2e-2294-4a69-bd4e-d51f50e73e56 {{(pid=117939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 02:10:10.857116 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-de2d3e41-77b4-4869-8858-785ec8fb950a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56/os-volume_attachments/c47ed588-2d09-496b-91e6-c5803d3cc250" status: 202 len: 0 microversion: 2.20 time: 0.164379 Jun 08 02:10:10.857664 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 283/551] 10.222.0.20 () {60 vars in 1456 bytes} [Wed Jun 8 02:10:10 2022] DELETE /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56/os-volume_attachments/c47ed588-2d09-496b-91e6-c5803d3cc250 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 08 02:10:10.865932 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6900c9f5-2e29-4d99-b17d-3d6c68efea5c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:10.867043 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6900c9f5-2e29-4d99-b17d-3d6c68efea5c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:10.873661 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6900c9f5-2e29-4d99-b17d-3d6c68efea5c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:10.874104 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6900c9f5-2e29-4d99-b17d-3d6c68efea5c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:10.874946 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6900c9f5-2e29-4d99-b17d-3d6c68efea5c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:10.875371 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6900c9f5-2e29-4d99-b17d-3d6c68efea5c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:10.906220 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6900c9f5-2e29-4d99-b17d-3d6c68efea5c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044194 Jun 08 02:10:10.906782 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 269/552] 10.222.0.20 () {60 vars in 1342 bytes} [Wed Jun 8 02:10:10 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 08 02:10:11.919812 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-38893eaa-e6b7-496e-9356-da38735bbe7c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:11.920910 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-38893eaa-e6b7-496e-9356-da38735bbe7c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:11.927073 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-38893eaa-e6b7-496e-9356-da38735bbe7c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:11.927517 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-38893eaa-e6b7-496e-9356-da38735bbe7c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:11.928272 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-38893eaa-e6b7-496e-9356-da38735bbe7c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:11.928733 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-38893eaa-e6b7-496e-9356-da38735bbe7c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:11.956528 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-38893eaa-e6b7-496e-9356-da38735bbe7c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042067 Jun 08 02:10:11.957073 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 284/553] 10.222.0.20 () {60 vars in 1342 bytes} [Wed Jun 8 02:10:11 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:10:12.014557 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4d1294be-8f47-43ca-931a-e11bd30545c2 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:12.015034 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4d1294be-8f47-43ca-931a-e11bd30545c2 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:12.021432 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4d1294be-8f47-43ca-931a-e11bd30545c2 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:12.021877 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4d1294be-8f47-43ca-931a-e11bd30545c2 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:12.022634 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4d1294be-8f47-43ca-931a-e11bd30545c2 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:12.023069 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4d1294be-8f47-43ca-931a-e11bd30545c2 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:12.047346 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4d1294be-8f47-43ca-931a-e11bd30545c2 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Going to try to terminate instance {{(pid=117938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 02:10:12.122796 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4d1294be-8f47-43ca-931a-e11bd30545c2 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 204 len: 0 microversion: 2.20 time: 0.111576 Jun 08 02:10:12.123293 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 270/554] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Jun 8 02:10:12 2022] DELETE /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 08 02:10:12.132071 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-20dce055-6409-4826-93cd-cb78eb79f3b3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:12.134447 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-20dce055-6409-4826-93cd-cb78eb79f3b3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:12.140929 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-20dce055-6409-4826-93cd-cb78eb79f3b3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:12.141373 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-20dce055-6409-4826-93cd-cb78eb79f3b3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:12.142123 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-20dce055-6409-4826-93cd-cb78eb79f3b3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:12.142551 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-20dce055-6409-4826-93cd-cb78eb79f3b3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:12.270647 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-20dce055-6409-4826-93cd-cb78eb79f3b3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:12.279171 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-20dce055-6409-4826-93cd-cb78eb79f3b3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:12.281406 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-20dce055-6409-4826-93cd-cb78eb79f3b3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:12.282964 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-20dce055-6409-4826-93cd-cb78eb79f3b3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1724 microversion: 2.20 time: 0.154716 Jun 08 02:10:12.283844 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 285/555] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:10:12 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:10:13.301785 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4a1cf1d3-6088-4864-9229-731d31f7b7b5 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:13.302478 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4a1cf1d3-6088-4864-9229-731d31f7b7b5 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:13.309084 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4a1cf1d3-6088-4864-9229-731d31f7b7b5 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:13.309531 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4a1cf1d3-6088-4864-9229-731d31f7b7b5 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:13.310288 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4a1cf1d3-6088-4864-9229-731d31f7b7b5 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:13.310725 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4a1cf1d3-6088-4864-9229-731d31f7b7b5 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:13.444756 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4a1cf1d3-6088-4864-9229-731d31f7b7b5 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:13.453436 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4a1cf1d3-6088-4864-9229-731d31f7b7b5 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:13.454944 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4a1cf1d3-6088-4864-9229-731d31f7b7b5 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:13.456085 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4a1cf1d3-6088-4864-9229-731d31f7b7b5 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1724 microversion: 2.20 time: 0.158586 Jun 08 02:10:13.456715 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 271/556] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:10:13 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:10:14.475030 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0e0eeacf-4b85-4d2b-9158-d01644492023 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:14.475709 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-0e0eeacf-4b85-4d2b-9158-d01644492023 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:14.482487 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0e0eeacf-4b85-4d2b-9158-d01644492023 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:14.482939 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0e0eeacf-4b85-4d2b-9158-d01644492023 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:14.483734 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0e0eeacf-4b85-4d2b-9158-d01644492023 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:14.484349 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0e0eeacf-4b85-4d2b-9158-d01644492023 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:14.894116 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-0e0eeacf-4b85-4d2b-9158-d01644492023 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:14.904923 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-0e0eeacf-4b85-4d2b-9158-d01644492023 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:14.906957 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-0e0eeacf-4b85-4d2b-9158-d01644492023 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:14.912595 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-0e0eeacf-4b85-4d2b-9158-d01644492023 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1724 microversion: 2.20 time: 0.437762 Jun 08 02:10:14.920759 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 286/557] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:10:14 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1724 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:10:15.223781 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-053b8bed-1173-46c4-9d88-922ab6e6d00f req-8ff2c638-955d-41d9-87ea-b4820cf0a81d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7944f2e-2294-4a69-bd4e-d51f50e73e56", "name": "network-vif-deleted", "tag": "4c178719-6047-43d9-9d57-30618b0b060e"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:10:15.235376 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-053b8bed-1173-46c4-9d88-922ab6e6d00f req-8ff2c638-955d-41d9-87ea-b4820cf0a81d service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:15.235806 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-053b8bed-1173-46c4-9d88-922ab6e6d00f req-8ff2c638-955d-41d9-87ea-b4820cf0a81d service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:15.247979 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-053b8bed-1173-46c4-9d88-922ab6e6d00f req-8ff2c638-955d-41d9-87ea-b4820cf0a81d service nova] Creating event network-vif-deleted:4c178719-6047-43d9-9d57-30618b0b060e for instance b7944f2e-2294-4a69-bd4e-d51f50e73e56 on hv-cinder-84506 Jun 08 02:10:15.253263 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-053b8bed-1173-46c4-9d88-922ab6e6d00f req-8ff2c638-955d-41d9-87ea-b4820cf0a81d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033030 Jun 08 02:10:15.253794 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 272/558] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:10:15.951645 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-791eb186-78c1-4ecf-b557-946e1f09b2e9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:15.952286 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-791eb186-78c1-4ecf-b557-946e1f09b2e9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:15.959152 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-791eb186-78c1-4ecf-b557-946e1f09b2e9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:15.960003 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-791eb186-78c1-4ecf-b557-946e1f09b2e9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:15.961118 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-791eb186-78c1-4ecf-b557-946e1f09b2e9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:15.962695 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-791eb186-78c1-4ecf-b557-946e1f09b2e9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:16.040146 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-791eb186-78c1-4ecf-b557-946e1f09b2e9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:16.048947 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-791eb186-78c1-4ecf-b557-946e1f09b2e9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:16.050497 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-791eb186-78c1-4ecf-b557-946e1f09b2e9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:16.051665 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-791eb186-78c1-4ecf-b557-946e1f09b2e9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1656 microversion: 2.20 time: 0.104067 Jun 08 02:10:16.052216 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 287/559] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:10:15 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1656 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:10:17.072224 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-df7cbda9-0d2e-472d-a9b6-cbe0414801ce tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:17.073699 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-df7cbda9-0d2e-472d-a9b6-cbe0414801ce tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:17.080216 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-df7cbda9-0d2e-472d-a9b6-cbe0414801ce tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:17.080702 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-df7cbda9-0d2e-472d-a9b6-cbe0414801ce tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:17.081738 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-df7cbda9-0d2e-472d-a9b6-cbe0414801ce tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:17.082247 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-df7cbda9-0d2e-472d-a9b6-cbe0414801ce tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:17.114285 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-df7cbda9-0d2e-472d-a9b6-cbe0414801ce tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:17.114830 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-df7cbda9-0d2e-472d-a9b6-cbe0414801ce tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:17.115391 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-df7cbda9-0d2e-472d-a9b6-cbe0414801ce tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lazy-loading 'fault' on Instance uuid b7944f2e-2294-4a69-bd4e-d51f50e73e56 {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 02:10:17.165003 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-df7cbda9-0d2e-472d-a9b6-cbe0414801ce tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:17.174154 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-df7cbda9-0d2e-472d-a9b6-cbe0414801ce tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:17.176038 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-df7cbda9-0d2e-472d-a9b6-cbe0414801ce tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:17.177458 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-df7cbda9-0d2e-472d-a9b6-cbe0414801ce tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 200 len: 1372 microversion: 2.20 time: 0.110641 Jun 08 02:10:17.178136 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 273/560] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:10:17 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 1372 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:10:18.197471 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-5267bb22-ea25-4ef3-9ae1-56126cc04457 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:18.198149 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-5267bb22-ea25-4ef3-9ae1-56126cc04457 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:18.204996 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5267bb22-ea25-4ef3-9ae1-56126cc04457 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:18.205526 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5267bb22-ea25-4ef3-9ae1-56126cc04457 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:18.206374 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5267bb22-ea25-4ef3-9ae1-56126cc04457 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:18.206877 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5267bb22-ea25-4ef3-9ae1-56126cc04457 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:18.221691 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-5267bb22-ea25-4ef3-9ae1-56126cc04457 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] HTTP exception thrown: Instance b7944f2e-2294-4a69-bd4e-d51f50e73e56 could not be found. Jun 08 02:10:18.223448 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-5267bb22-ea25-4ef3-9ae1-56126cc04457 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Request method failure captured: Jun 08 02:10:18.223448 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 HTTP/1.1 Jun 08 02:10:18.223448 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept: application/json Jun 08 02:10:18.223448 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jun 08 02:10:18.223448 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Connection: close Jun 08 02:10:18.223448 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jun 08 02:10:18.223448 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jun 08 02:10:18.223448 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Host: 10.222.0.20 Jun 08 02:10:18.223448 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jun 08 02:10:18.223448 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jun 08 02:10:18.223448 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABioAQ5Q-kUAsXXvLlpD_vYTS_7Cpa1UAreb9KfSGFfqnpepRbFXxhuJ2XB5BrVclykIXGPkhYy5vkv1P-6xYsW7EcD9VCdOVs5ad6zVygMxRb19EBZmRfA7p-4qsREHksD7Kz2ms_5tPzTz35DUlR3oX6FYY6jgHb8NUH7WRjcGG89vsI Jun 08 02:10:18.223448 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jun 08 02:10:18.223448 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jun 08 02:10:18.223448 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jun 08 02:10:18.223448 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jun 08 02:10:18.223448 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Openstack-Nova-Api-Version: 2.20 Jun 08 02:10:18.223448 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jun 08 02:10:18.223448 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jun 08 02:10:18.223448 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Id: 7daf0f9fd80c464ca4fbf7f2e19fccbd Jun 08 02:10:18.223448 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-248114998 Jun 08 02:10:18.223448 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jun 08 02:10:18.223448 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jun 08 02:10:18.224924 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7daf0f9fd80c464ca4fbf7f2e19fccbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7daf0f9fd80c464ca4fbf7f2e19fccbd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7daf0f9fd80c464ca4fbf7f2e19fccbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7daf0f9fd80c464ca4fbf7f2e19fccbd"}]}] Jun 08 02:10:18.224924 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-AttachVolumeShelveTestJSON-248114998 Jun 08 02:10:18.224924 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 7daf0f9fd80c464ca4fbf7f2e19fccbd Jun 08 02:10:18.224924 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-248114998 Jun 08 02:10:18.224924 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User: tempest-AttachVolumeShelveTestJSON-248114998-project Jun 08 02:10:18.224924 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jun 08 02:10:18.224924 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jun 08 02:10:18.224924 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Id: a3b4081bebe74c839f5aa214275210b4 Jun 08 02:10:18.224924 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-AttachVolumeShelveTestJSON-248114998-project Jun 08 02:10:18.224924 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: method: > Jun 08 02:10:18.224924 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: exception: Instance b7944f2e-2294-4a69-bd4e-d51f50e73e56 could not be found. Jun 08 02:10:18.224924 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: action_args: {'id': 'b7944f2e-2294-4a69-bd4e-d51f50e73e56'} Jun 08 02:10:18.225700 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:10:18.225700 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:10:18.225700 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:10:18.225700 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:10:18.225700 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:10:18.225700 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:10:18.225700 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:10:18.225700 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:10:18.225700 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:10:18.225700 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:10:18.225700 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7944f2e-2294-4a69-bd4e-d51f50e73e56 could not be found. Jun 08 02:10:18.225700 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:10:18.225700 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:10:18.225700 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:10:18.225700 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:10:18.225700 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:10:18.225700 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:10:18.225700 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:10:18.225700 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:10:18.225700 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:10:18.227560 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:10:18.227560 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 02:10:18.227560 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 02:10:18.227560 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:10:18.227560 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:10:18.227560 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:10:18.227560 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:10:18.227560 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7944f2e-2294-4a69-bd4e-d51f50e73e56 could not be found. Jun 08 02:10:18.227560 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:10:18.227560 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:10:18.227560 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:10:18.227560 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:10:18.227560 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:10:18.227560 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:10:18.227560 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:10:18.227560 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:10:18.227560 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7944f2e-2294-4a69-bd4e-d51f50e73e56 could not be found. Jun 08 02:10:18.227560 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:10:18.230577 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-5267bb22-ea25-4ef3-9ae1-56126cc04457 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Returning 404 to user: Instance b7944f2e-2294-4a69-bd4e-d51f50e73e56 could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:10:18.231690 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-5267bb22-ea25-4ef3-9ae1-56126cc04457 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 404 len: 111 microversion: 2.20 time: 0.038936 Jun 08 02:10:18.232320 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 288/561] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:10:18 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 08 02:10:18.242339 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-90416fe3-2705-44dc-9bc1-21700e7f5896 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '.version_select at 0x7f836af02940>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:18.269058 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-90416fe3-2705-44dc-9bc1-21700e7f5896 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2123619290" status: 204 len: 0 microversion: 2.20 time: 0.031932 Jun 08 02:10:18.269742 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 274/562] 10.222.0.20 () {60 vars in 1261 bytes} [Wed Jun 8 02:10:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2123619290 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 08 02:10:18.940383 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-4a7ee33e-608c-4c6b-8878-d97c3a512207 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Action: 'create', calling method: .version_select at 0x7f836ae4c280>, body: {"keypair": {"name": "tempest-keypair-1270933572", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQzSktT4B6nvrrMzAV+abTcJ9z2ct8aKK5mAJijVnY84ZDtvmIOyfRzJ5VXIdatnr8bLnMyWRAaXFCp2NeJc9bVJBCxmY+L8+4SQOdNNaC819095nNDien5Nmz1IFU2cQ=="}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:10:18.955059 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-4a7ee33e-608c-4c6b-8878-d97c3a512207 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Getting quotas for project 7daf0f9fd80c464ca4fbf7f2e19fccbd. Resources: {'key_pairs'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 02:10:18.959089 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-4a7ee33e-608c-4c6b-8878-d97c3a512207 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Getting quotas for user a3b4081bebe74c839f5aa214275210b4 and project 7daf0f9fd80c464ca4fbf7f2e19fccbd. Resources: {'key_pairs'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 02:10:18.981831 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-4a7ee33e-608c-4c6b-8878-d97c3a512207 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.045360 Jun 08 02:10:18.982424 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 289/563] 10.222.0.20 () {62 vars in 1199 bytes} [Wed Jun 8 02:10:18 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 08 02:10:20.281534 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-259b93b8-5f09-481a-8c98-d128bc91e69a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-613107004", "imageRef": "e648e482-e374-429d-8152-a4a63797f314", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "99df6c84-8305-4b75-a40c-3f742f20dcc7"}], "security_groups": [{"name": "tempest-securitygroup--1841982228"}], "key_name": "tempest-keypair-1270933572", "user_data": "}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:10:20.387537 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.network.neutron [None req-259b93b8-5f09-481a-8c98-d128bc91e69a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] validate_networks() for [('99df6c84-8305-4b75-a40c-3f742f20dcc7', None, None, None, None, None)] {{(pid=117938) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 02:10:20.749394 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-259b93b8-5f09-481a-8c98-d128bc91e69a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Flavor limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 02:10:20.749842 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-259b93b8-5f09-481a-8c98-d128bc91e69a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Image limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 02:10:20.750316 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-259b93b8-5f09-481a-8c98-d128bc91e69a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Flavor pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 02:10:20.750724 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-259b93b8-5f09-481a-8c98-d128bc91e69a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Image pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 02:10:20.751214 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-259b93b8-5f09-481a-8c98-d128bc91e69a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 02:10:20.760719 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-259b93b8-5f09-481a-8c98-d128bc91e69a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:20.761167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-259b93b8-5f09-481a-8c98-d128bc91e69a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:20.761955 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-259b93b8-5f09-481a-8c98-d128bc91e69a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:20.762386 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-259b93b8-5f09-481a-8c98-d128bc91e69a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:20.778605 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-259b93b8-5f09-481a-8c98-d128bc91e69a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Getting quotas for project 7daf0f9fd80c464ca4fbf7f2e19fccbd. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 02:10:20.783068 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-259b93b8-5f09-481a-8c98-d128bc91e69a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Getting quotas for user a3b4081bebe74c839f5aa214275210b4 and project 7daf0f9fd80c464ca4fbf7f2e19fccbd. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 02:10:20.794888 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-259b93b8-5f09-481a-8c98-d128bc91e69a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Going to run 1 instances... {{(pid=117938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 02:10:20.797208 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-259b93b8-5f09-481a-8c98-d128bc91e69a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e648e482-e374-429d-8152-a4a63797f314',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 02:10:20.842454 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-259b93b8-5f09-481a-8c98-d128bc91e69a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.565740 Jun 08 02:10:20.843094 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 275/564] 10.222.0.20 () {62 vars in 1187 bytes} [Wed Jun 8 02:10:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 08 02:10:20.854737 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e0dd4967-eb1a-4540-bf87-4a2cc23f4fc3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:20.855437 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e0dd4967-eb1a-4540-bf87-4a2cc23f4fc3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:20.922795 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e0dd4967-eb1a-4540-bf87-4a2cc23f4fc3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:20.932205 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e0dd4967-eb1a-4540-bf87-4a2cc23f4fc3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:20.933747 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e0dd4967-eb1a-4540-bf87-4a2cc23f4fc3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:20.934832 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e0dd4967-eb1a-4540-bf87-4a2cc23f4fc3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1281 microversion: 2.20 time: 0.085193 Jun 08 02:10:20.935368 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 290/565] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:10:20 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1281 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:10:21.955310 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-57658736-7a7a-4d01-a7af-b93fdc25f7d4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:21.955918 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-57658736-7a7a-4d01-a7af-b93fdc25f7d4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:21.963684 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-57658736-7a7a-4d01-a7af-b93fdc25f7d4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:21.964136 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-57658736-7a7a-4d01-a7af-b93fdc25f7d4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:21.965141 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-57658736-7a7a-4d01-a7af-b93fdc25f7d4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:21.965574 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-57658736-7a7a-4d01-a7af-b93fdc25f7d4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:22.158288 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-57658736-7a7a-4d01-a7af-b93fdc25f7d4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:22.168271 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-57658736-7a7a-4d01-a7af-b93fdc25f7d4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:22.174209 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-57658736-7a7a-4d01-a7af-b93fdc25f7d4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:22.175482 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-57658736-7a7a-4d01-a7af-b93fdc25f7d4 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1339 microversion: 2.20 time: 0.225559 Jun 08 02:10:22.176523 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 276/566] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:10:21 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1339 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:10:23.195133 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-36f6fb4d-c504-41a5-96e4-df2e6c70e516 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:23.197024 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-36f6fb4d-c504-41a5-96e4-df2e6c70e516 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:23.208744 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:10:23.214524 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-36f6fb4d-c504-41a5-96e4-df2e6c70e516 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:23.215007 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-36f6fb4d-c504-41a5-96e4-df2e6c70e516 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:23.215869 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-36f6fb4d-c504-41a5-96e4-df2e6c70e516 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:23.216359 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-36f6fb4d-c504-41a5-96e4-df2e6c70e516 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:23.286687 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-cc3710fa-c7c0-49f4-8435-e0a605b08a13 req-dc5a282e-bcfc-43ce-b1e7-d5a34cbd86e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19726b62-06f4-4547-9021-b58c9571f183", "tag": "92dccdf3-f4c8-42b5-aee4-d2373577dd65"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:10:23.307292 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-cc3710fa-c7c0-49f4-8435-e0a605b08a13 req-dc5a282e-bcfc-43ce-b1e7-d5a34cbd86e8 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:23.309490 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-cc3710fa-c7c0-49f4-8435-e0a605b08a13 req-dc5a282e-bcfc-43ce-b1e7-d5a34cbd86e8 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:23.323460 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-cc3710fa-c7c0-49f4-8435-e0a605b08a13 req-dc5a282e-bcfc-43ce-b1e7-d5a34cbd86e8 service nova] Creating event network-changed:92dccdf3-f4c8-42b5-aee4-d2373577dd65 for instance 19726b62-06f4-4547-9021-b58c9571f183 on hv-cinder-84506 Jun 08 02:10:23.328854 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-cc3710fa-c7c0-49f4-8435-e0a605b08a13 req-dc5a282e-bcfc-43ce-b1e7-d5a34cbd86e8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046654 Jun 08 02:10:23.330635 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 277/567] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:10:23.511616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-36f6fb4d-c504-41a5-96e4-df2e6c70e516 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:23.519468 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-36f6fb4d-c504-41a5-96e4-df2e6c70e516 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:23.521030 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-36f6fb4d-c504-41a5-96e4-df2e6c70e516 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:23.522130 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-36f6fb4d-c504-41a5-96e4-df2e6c70e516 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1407 microversion: 2.20 time: 0.331565 Jun 08 02:10:23.522716 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 291/568] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:10:23 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1407 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:10:24.541355 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c9b9f707-2eb1-4aef-9f05-431df6b2339b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:24.542044 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c9b9f707-2eb1-4aef-9f05-431df6b2339b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:24.548454 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c9b9f707-2eb1-4aef-9f05-431df6b2339b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:24.548951 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c9b9f707-2eb1-4aef-9f05-431df6b2339b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:24.549704 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c9b9f707-2eb1-4aef-9f05-431df6b2339b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:24.550133 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c9b9f707-2eb1-4aef-9f05-431df6b2339b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:24.688866 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c9b9f707-2eb1-4aef-9f05-431df6b2339b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:24.697759 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c9b9f707-2eb1-4aef-9f05-431df6b2339b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:24.699299 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c9b9f707-2eb1-4aef-9f05-431df6b2339b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:24.700447 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c9b9f707-2eb1-4aef-9f05-431df6b2339b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1407 microversion: 2.20 time: 0.163827 Jun 08 02:10:24.700999 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 278/569] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:10:24 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:10:25.718870 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-1d5df960-7bae-4b9f-9e28-96518bc6a215 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:25.719700 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-1d5df960-7bae-4b9f-9e28-96518bc6a215 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:25.728292 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1d5df960-7bae-4b9f-9e28-96518bc6a215 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:25.729276 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1d5df960-7bae-4b9f-9e28-96518bc6a215 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:25.730558 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1d5df960-7bae-4b9f-9e28-96518bc6a215 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:25.731211 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1d5df960-7bae-4b9f-9e28-96518bc6a215 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:25.947193 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1d5df960-7bae-4b9f-9e28-96518bc6a215 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:25.955010 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1d5df960-7bae-4b9f-9e28-96518bc6a215 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:25.956533 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1d5df960-7bae-4b9f-9e28-96518bc6a215 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:25.957621 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-1d5df960-7bae-4b9f-9e28-96518bc6a215 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1407 microversion: 2.20 time: 0.243073 Jun 08 02:10:25.958160 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 292/570] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:10:25 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:10:26.975450 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9867e641-0908-4359-8971-eb5d90363caa tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:26.976354 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9867e641-0908-4359-8971-eb5d90363caa tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:26.982884 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:10:26.985124 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9867e641-0908-4359-8971-eb5d90363caa tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:26.985664 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9867e641-0908-4359-8971-eb5d90363caa tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:26.986534 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9867e641-0908-4359-8971-eb5d90363caa tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:26.987258 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9867e641-0908-4359-8971-eb5d90363caa tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:27.127983 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9867e641-0908-4359-8971-eb5d90363caa tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:27.136872 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9867e641-0908-4359-8971-eb5d90363caa tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:27.138389 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9867e641-0908-4359-8971-eb5d90363caa tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:27.139492 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9867e641-0908-4359-8971-eb5d90363caa tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1407 microversion: 2.20 time: 0.168012 Jun 08 02:10:27.140043 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 279/571] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:10:26 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:10:27.636594 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-7254c379-674b-4ed8-a8e4-df02c482794d tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:27.637529 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-7254c379-674b-4ed8-a8e4-df02c482794d tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:27.643618 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7254c379-674b-4ed8-a8e4-df02c482794d tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:27.644069 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7254c379-674b-4ed8-a8e4-df02c482794d tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:27.644869 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7254c379-674b-4ed8-a8e4-df02c482794d tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:27.645304 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7254c379-674b-4ed8-a8e4-df02c482794d tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:27.675615 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-7254c379-674b-4ed8-a8e4-df02c482794d tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043413 Jun 08 02:10:27.676551 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 293/572] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jun 8 02:10:27 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 08 02:10:27.734339 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-707469c1-7cf3-44e5-94ae-d4096902b2a7 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:27.734825 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-707469c1-7cf3-44e5-94ae-d4096902b2a7 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:27.740724 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-707469c1-7cf3-44e5-94ae-d4096902b2a7 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:27.741165 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-707469c1-7cf3-44e5-94ae-d4096902b2a7 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:27.741912 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-707469c1-7cf3-44e5-94ae-d4096902b2a7 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:27.742341 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-707469c1-7cf3-44e5-94ae-d4096902b2a7 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:27.769526 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-707469c1-7cf3-44e5-94ae-d4096902b2a7 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Going to try to terminate instance {{(pid=117938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 02:10:27.853492 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-707469c1-7cf3-44e5-94ae-d4096902b2a7 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 204 len: 0 microversion: 2.1 time: 0.122621 Jun 08 02:10:27.854119 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 280/573] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jun 8 02:10:27 2022] DELETE /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 08 02:10:27.862558 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e3ca6be3-35e7-46bf-9b27-354b86da1aee tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:27.863173 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e3ca6be3-35e7-46bf-9b27-354b86da1aee tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:27.869716 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e3ca6be3-35e7-46bf-9b27-354b86da1aee tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:27.870164 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e3ca6be3-35e7-46bf-9b27-354b86da1aee tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:27.870928 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e3ca6be3-35e7-46bf-9b27-354b86da1aee tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:27.871364 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e3ca6be3-35e7-46bf-9b27-354b86da1aee tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:28.083475 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e3ca6be3-35e7-46bf-9b27-354b86da1aee tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:28.091355 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e3ca6be3-35e7-46bf-9b27-354b86da1aee tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1673 microversion: 2.1 time: 0.232796 Jun 08 02:10:28.092352 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 294/574] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:10:27 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1673 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:10:28.159212 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3b5f1de7-70a6-4fe0-8156-b4c4a47e6fb9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:28.159935 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3b5f1de7-70a6-4fe0-8156-b4c4a47e6fb9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:28.166909 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3b5f1de7-70a6-4fe0-8156-b4c4a47e6fb9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:28.167361 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3b5f1de7-70a6-4fe0-8156-b4c4a47e6fb9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:28.168137 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3b5f1de7-70a6-4fe0-8156-b4c4a47e6fb9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:28.168611 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3b5f1de7-70a6-4fe0-8156-b4c4a47e6fb9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:28.326922 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3b5f1de7-70a6-4fe0-8156-b4c4a47e6fb9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:28.334961 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3b5f1de7-70a6-4fe0-8156-b4c4a47e6fb9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:28.336538 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3b5f1de7-70a6-4fe0-8156-b4c4a47e6fb9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:28.337647 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3b5f1de7-70a6-4fe0-8156-b4c4a47e6fb9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1407 microversion: 2.20 time: 0.182977 Jun 08 02:10:28.338197 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 281/575] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:10:28 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:10:29.108594 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2829b9de-7818-4f85-944b-fdbb449109f5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:29.109210 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-2829b9de-7818-4f85-944b-fdbb449109f5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:29.117305 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-5f23d0c9-3817-4074-983b-39543d69b9e8 req-d05eefb1-0ba9-453d-ab1b-481fcb618ecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19726b62-06f4-4547-9021-b58c9571f183", "name": "network-vif-plugged", "status": "completed", "tag": "92dccdf3-f4c8-42b5-aee4-d2373577dd65"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:10:29.125690 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-5f23d0c9-3817-4074-983b-39543d69b9e8 req-d05eefb1-0ba9-453d-ab1b-481fcb618ecd service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:29.126181 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2829b9de-7818-4f85-944b-fdbb449109f5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:29.126544 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-5f23d0c9-3817-4074-983b-39543d69b9e8 req-d05eefb1-0ba9-453d-ab1b-481fcb618ecd service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:29.126723 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2829b9de-7818-4f85-944b-fdbb449109f5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:29.127773 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2829b9de-7818-4f85-944b-fdbb449109f5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:29.128306 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2829b9de-7818-4f85-944b-fdbb449109f5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:29.141026 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-5f23d0c9-3817-4074-983b-39543d69b9e8 req-d05eefb1-0ba9-453d-ab1b-481fcb618ecd service nova] Creating event network-vif-plugged:92dccdf3-f4c8-42b5-aee4-d2373577dd65 for instance 19726b62-06f4-4547-9021-b58c9571f183 on hv-cinder-84506 Jun 08 02:10:29.145864 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-5f23d0c9-3817-4074-983b-39543d69b9e8 req-d05eefb1-0ba9-453d-ab1b-481fcb618ecd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032168 Jun 08 02:10:29.146468 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 282/576] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:10:29.261701 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2829b9de-7818-4f85-944b-fdbb449109f5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:29.269122 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2829b9de-7818-4f85-944b-fdbb449109f5 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1673 microversion: 2.1 time: 0.164494 Jun 08 02:10:29.269674 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 295/577] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:10:29 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:10:29.355951 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-865256c4-80c7-4469-a16e-7f8328477122 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:29.356672 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-865256c4-80c7-4469-a16e-7f8328477122 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:29.362850 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-865256c4-80c7-4469-a16e-7f8328477122 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:29.363295 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-865256c4-80c7-4469-a16e-7f8328477122 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:29.364048 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-865256c4-80c7-4469-a16e-7f8328477122 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:29.364517 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-865256c4-80c7-4469-a16e-7f8328477122 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:29.495331 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-865256c4-80c7-4469-a16e-7f8328477122 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:29.503164 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-865256c4-80c7-4469-a16e-7f8328477122 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:29.504710 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-865256c4-80c7-4469-a16e-7f8328477122 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:29.505804 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-865256c4-80c7-4469-a16e-7f8328477122 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1407 microversion: 2.20 time: 0.154608 Jun 08 02:10:29.506359 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 283/578] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:10:29 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:10:30.286409 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-15297830-5765-4e27-8529-a7bf9b8ede95 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:30.287019 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-15297830-5765-4e27-8529-a7bf9b8ede95 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:30.294206 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-15297830-5765-4e27-8529-a7bf9b8ede95 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:30.294656 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-15297830-5765-4e27-8529-a7bf9b8ede95 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:30.295408 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-15297830-5765-4e27-8529-a7bf9b8ede95 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:30.295843 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-15297830-5765-4e27-8529-a7bf9b8ede95 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:30.515307 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-15297830-5765-4e27-8529-a7bf9b8ede95 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:30.523256 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-15297830-5765-4e27-8529-a7bf9b8ede95 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1673 microversion: 2.1 time: 0.240900 Jun 08 02:10:30.523822 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 296/579] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:10:30 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1673 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:10:30.525110 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1c4c125f-e7f6-4960-8a07-e10d7e610560 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:30.525721 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-1c4c125f-e7f6-4960-8a07-e10d7e610560 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:30.532595 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1c4c125f-e7f6-4960-8a07-e10d7e610560 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:30.533043 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1c4c125f-e7f6-4960-8a07-e10d7e610560 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:30.533938 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1c4c125f-e7f6-4960-8a07-e10d7e610560 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:30.534377 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1c4c125f-e7f6-4960-8a07-e10d7e610560 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:30.745898 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-1c4c125f-e7f6-4960-8a07-e10d7e610560 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:30.748215 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:10:30.755104 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-1c4c125f-e7f6-4960-8a07-e10d7e610560 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:30.756647 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-1c4c125f-e7f6-4960-8a07-e10d7e610560 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:30.757754 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1c4c125f-e7f6-4960-8a07-e10d7e610560 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1407 microversion: 2.20 time: 0.237439 Jun 08 02:10:30.758326 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 284/580] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:10:30 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 02:10:31.310068 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-aa11a798-4d59-4aeb-9402-5b5b2b72faff req-cf0c3639-bf41-4a1a-8fdb-bc6fadfa443c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b508446f-daa7-46a1-be64-fd8528cfa380", "name": "network-vif-deleted", "tag": "f15849eb-1bf4-44c4-8575-7be145474d94"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:10:31.313538 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=6 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:10:31.319827 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-aa11a798-4d59-4aeb-9402-5b5b2b72faff req-cf0c3639-bf41-4a1a-8fdb-bc6fadfa443c service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:31.320270 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-aa11a798-4d59-4aeb-9402-5b5b2b72faff req-cf0c3639-bf41-4a1a-8fdb-bc6fadfa443c service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:31.332372 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-aa11a798-4d59-4aeb-9402-5b5b2b72faff req-cf0c3639-bf41-4a1a-8fdb-bc6fadfa443c service nova] Creating event network-vif-deleted:f15849eb-1bf4-44c4-8575-7be145474d94 for instance b508446f-daa7-46a1-be64-fd8528cfa380 on hv-cinder-84506 Jun 08 02:10:31.337972 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-aa11a798-4d59-4aeb-9402-5b5b2b72faff req-cf0c3639-bf41-4a1a-8fdb-bc6fadfa443c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031707 Jun 08 02:10:31.338558 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 297/581] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:10:31.543174 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e0dc2d27-f332-4bd0-94e1-fa21cbca6861 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:31.543755 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e0dc2d27-f332-4bd0-94e1-fa21cbca6861 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:31.545806 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:10:31.546478 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=6 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:10:31.555682 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e0dc2d27-f332-4bd0-94e1-fa21cbca6861 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:31.556928 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e0dc2d27-f332-4bd0-94e1-fa21cbca6861 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:31.557706 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e0dc2d27-f332-4bd0-94e1-fa21cbca6861 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:31.558135 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e0dc2d27-f332-4bd0-94e1-fa21cbca6861 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:31.625199 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e0dc2d27-f332-4bd0-94e1-fa21cbca6861 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:31.632662 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e0dc2d27-f332-4bd0-94e1-fa21cbca6861 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 200 len: 1606 microversion: 2.1 time: 0.095363 Jun 08 02:10:31.634090 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 285/582] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:10:31 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 1606 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:10:31.779219 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d56e366e-ad7d-4909-8b73-a5c2379441e5 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:31.780734 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d56e366e-ad7d-4909-8b73-a5c2379441e5 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:31.788413 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d56e366e-ad7d-4909-8b73-a5c2379441e5 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:31.788891 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d56e366e-ad7d-4909-8b73-a5c2379441e5 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:31.789777 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d56e366e-ad7d-4909-8b73-a5c2379441e5 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:31.790320 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d56e366e-ad7d-4909-8b73-a5c2379441e5 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:31.793535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:10:31.941205 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d56e366e-ad7d-4909-8b73-a5c2379441e5 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:31.949488 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d56e366e-ad7d-4909-8b73-a5c2379441e5 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:31.950929 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d56e366e-ad7d-4909-8b73-a5c2379441e5 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:31.952023 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d56e366e-ad7d-4909-8b73-a5c2379441e5 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1407 microversion: 2.20 time: 0.179780 Jun 08 02:10:31.952622 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 298/583] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:10:31 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 02:10:32.872917 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-30361265-fbf9-4333-ae89-40fd623c499e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:32.873526 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-30361265-fbf9-4333-ae89-40fd623c499e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:32.879512 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-30361265-fbf9-4333-ae89-40fd623c499e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:32.879961 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-30361265-fbf9-4333-ae89-40fd623c499e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:32.880748 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-30361265-fbf9-4333-ae89-40fd623c499e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:32.881186 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-30361265-fbf9-4333-ae89-40fd623c499e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:32.895140 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-30361265-fbf9-4333-ae89-40fd623c499e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] HTTP exception thrown: Instance b508446f-daa7-46a1-be64-fd8528cfa380 could not be found. Jun 08 02:10:32.896968 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-30361265-fbf9-4333-ae89-40fd623c499e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Request method failure captured: Jun 08 02:10:32.896968 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 HTTP/1.1 Jun 08 02:10:32.896968 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept: application/json Jun 08 02:10:32.896968 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jun 08 02:10:32.896968 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Connection: close Jun 08 02:10:32.896968 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jun 08 02:10:32.896968 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jun 08 02:10:32.896968 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Host: 10.222.0.20 Jun 08 02:10:32.896968 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jun 08 02:10:32.896968 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jun 08 02:10:32.896968 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABioAPruCb3ZyVjnBR9xX7jet-ghimTaVPiZeXdjX5RQP3HgkXpFkIFH5N8xgnWqRgsT6I2aqtXziMXFjRQ81Zxa0cQ3vkw8PhQlhyPdcAGwi5zmqH8qiWuC3J9KnW7yZD82jUljPEBc5VOaH4zABHhrL0GaEIkKthfPNB-DUtnqK3CO9I Jun 08 02:10:32.896968 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jun 08 02:10:32.896968 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jun 08 02:10:32.896968 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jun 08 02:10:32.896968 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jun 08 02:10:32.896968 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jun 08 02:10:32.896968 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jun 08 02:10:32.896968 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Id: 27f98152ab3440cf824c9ceb1c790bcf Jun 08 02:10:32.896968 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeTestJSON-1681895122 Jun 08 02:10:32.896968 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jun 08 02:10:32.896968 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jun 08 02:10:32.898458 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27f98152ab3440cf824c9ceb1c790bcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27f98152ab3440cf824c9ceb1c790bcf", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27f98152ab3440cf824c9ceb1c790bcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27f98152ab3440cf824c9ceb1c790bcf"}]}] Jun 08 02:10:32.898458 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeTestJSON-1681895122 Jun 08 02:10:32.898458 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 27f98152ab3440cf824c9ceb1c790bcf Jun 08 02:10:32.898458 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1681895122 Jun 08 02:10:32.898458 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeTestJSON-1681895122-project Jun 08 02:10:32.898458 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jun 08 02:10:32.898458 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jun 08 02:10:32.898458 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Id: 1b43d2b8b9084099b832332a565e741c Jun 08 02:10:32.898458 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeTestJSON-1681895122-project Jun 08 02:10:32.898458 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: method: > Jun 08 02:10:32.898458 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: exception: Instance b508446f-daa7-46a1-be64-fd8528cfa380 could not be found. Jun 08 02:10:32.898458 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: action_args: {'id': 'b508446f-daa7-46a1-be64-fd8528cfa380'} Jun 08 02:10:32.900097 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:10:32.900097 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:10:32.900097 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:10:32.900097 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:10:32.900097 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:10:32.900097 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:10:32.900097 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:10:32.900097 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:10:32.900097 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:10:32.900097 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:10:32.900097 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b508446f-daa7-46a1-be64-fd8528cfa380 could not be found. Jun 08 02:10:32.900097 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:10:32.900097 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:10:32.900097 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:10:32.900097 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:10:32.900097 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:10:32.900097 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:10:32.900097 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:10:32.900097 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:10:32.900097 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:10:32.901502 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:10:32.901502 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 02:10:32.901502 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 02:10:32.901502 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:10:32.901502 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:10:32.901502 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:10:32.901502 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:10:32.901502 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b508446f-daa7-46a1-be64-fd8528cfa380 could not be found. Jun 08 02:10:32.901502 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:10:32.901502 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:10:32.901502 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:10:32.901502 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:10:32.901502 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:10:32.901502 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:10:32.901502 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:10:32.901502 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:10:32.901502 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b508446f-daa7-46a1-be64-fd8528cfa380 could not be found. Jun 08 02:10:32.901502 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:10:32.902861 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-30361265-fbf9-4333-ae89-40fd623c499e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Returning 404 to user: Instance b508446f-daa7-46a1-be64-fd8528cfa380 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:10:32.902861 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-30361265-fbf9-4333-ae89-40fd623c499e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 404 len: 111 microversion: 2.1 time: 0.251091 Jun 08 02:10:32.902861 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 286/584] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:10:32 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 111 bytes in 252 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 02:10:32.908181 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-3205444c-7c80-4f64-baf3-aaca500e494f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '.version_select at 0x7f8370068af0>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:32.926038 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-3205444c-7c80-4f64-baf3-aaca500e494f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-668875470" status: 202 len: 0 microversion: 2.1 time: 0.022081 Jun 08 02:10:32.926604 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 299/585] 10.222.0.20 () {58 vars in 1217 bytes} [Wed Jun 8 02:10:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-668875470 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 02:10:32.972614 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-bda9860d-3c2a-4782-b399-cee50a380b1e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:32.973407 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-bda9860d-3c2a-4782-b399-cee50a380b1e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:32.979832 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bda9860d-3c2a-4782-b399-cee50a380b1e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:32.980271 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bda9860d-3c2a-4782-b399-cee50a380b1e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:32.981086 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bda9860d-3c2a-4782-b399-cee50a380b1e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:32.981517 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bda9860d-3c2a-4782-b399-cee50a380b1e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:33.145489 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-bda9860d-3c2a-4782-b399-cee50a380b1e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:33.155481 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-bda9860d-3c2a-4782-b399-cee50a380b1e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:33.157326 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-bda9860d-3c2a-4782-b399-cee50a380b1e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:33.158533 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-bda9860d-3c2a-4782-b399-cee50a380b1e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1599 microversion: 2.20 time: 0.191427 Jun 08 02:10:33.159213 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 287/586] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:10:32 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1599 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:10:33.176954 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d18adb96-550e-409c-a439-169344b4a1cd tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:33.177523 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d18adb96-550e-409c-a439-169344b4a1cd tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:33.184121 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d18adb96-550e-409c-a439-169344b4a1cd tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:33.184715 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d18adb96-550e-409c-a439-169344b4a1cd tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:33.185633 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d18adb96-550e-409c-a439-169344b4a1cd tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:33.186116 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d18adb96-550e-409c-a439-169344b4a1cd tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:33.268837 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d18adb96-550e-409c-a439-169344b4a1cd tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.095706 Jun 08 02:10:33.269430 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 300/587] 10.222.0.20 () {60 vars in 1315 bytes} [Wed Jun 8 02:10:33 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 08 02:10:33.607009 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3be0ff62-15ed-4f41-87a5-7df064f432f1 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Action: 'create', calling method: .version_select at 0x7f8370068e50>, body: {"keypair": {"name": "tempest-keypair-126195227", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaJSWf/HmTHehbAAY/G9z6lo13AK+j7kKPNrWdDf9Y6Sg7UpsaQNa243AK3URJD3WS2psrZ1jRjGBvu1pch50izfSIgwZeMjtHRQWCLTbuqKbv4LtG2D6eS8Z05rk4Rgw=="}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:10:33.621945 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-3be0ff62-15ed-4f41-87a5-7df064f432f1 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Getting quotas for project 27f98152ab3440cf824c9ceb1c790bcf. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 02:10:33.625718 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-3be0ff62-15ed-4f41-87a5-7df064f432f1 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Getting quotas for user 1b43d2b8b9084099b832332a565e741c and project 27f98152ab3440cf824c9ceb1c790bcf. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 02:10:33.648057 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3be0ff62-15ed-4f41-87a5-7df064f432f1 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046251 Jun 08 02:10:33.648713 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 288/588] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jun 8 02:10:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:10:34.454363 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-46949f9b-d758-4286-8a4c-0b70e942f42b req-0d995f04-fc41-41ec-a357-cb86175f6396 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19726b62-06f4-4547-9021-b58c9571f183", "tag": "92dccdf3-f4c8-42b5-aee4-d2373577dd65"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:10:34.463752 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-46949f9b-d758-4286-8a4c-0b70e942f42b req-0d995f04-fc41-41ec-a357-cb86175f6396 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:34.464328 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-46949f9b-d758-4286-8a4c-0b70e942f42b req-0d995f04-fc41-41ec-a357-cb86175f6396 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:34.478282 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-46949f9b-d758-4286-8a4c-0b70e942f42b req-0d995f04-fc41-41ec-a357-cb86175f6396 service nova] Creating event network-changed:92dccdf3-f4c8-42b5-aee4-d2373577dd65 for instance 19726b62-06f4-4547-9021-b58c9571f183 on hv-cinder-84506 Jun 08 02:10:34.484066 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-46949f9b-d758-4286-8a4c-0b70e942f42b req-0d995f04-fc41-41ec-a357-cb86175f6396 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033914 Jun 08 02:10:34.484813 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 301/589] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:10:34.958138 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-91d5e4a3-d058-401d-b193-875a59128815 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2103744061", "imageRef": "e648e482-e374-429d-8152-a4a63797f314", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "466dc4d7-a525-4704-a47b-5a136472c918"}], "security_groups": [{"name": "tempest-securitygroup--1716478312"}], "key_name": "tempest-keypair-126195227", "user_data": "}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:10:35.106338 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.network.neutron [None req-91d5e4a3-d058-401d-b193-875a59128815 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] validate_networks() for [('466dc4d7-a525-4704-a47b-5a136472c918', None, None, None, None, None)] {{(pid=117938) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 02:10:35.583586 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-91d5e4a3-d058-401d-b193-875a59128815 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Flavor limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 02:10:35.584031 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-91d5e4a3-d058-401d-b193-875a59128815 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Image limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 02:10:35.584568 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-91d5e4a3-d058-401d-b193-875a59128815 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Flavor pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 02:10:35.585031 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-91d5e4a3-d058-401d-b193-875a59128815 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Image pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 02:10:35.585446 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-91d5e4a3-d058-401d-b193-875a59128815 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 02:10:35.595436 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-91d5e4a3-d058-401d-b193-875a59128815 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:35.595882 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-91d5e4a3-d058-401d-b193-875a59128815 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:35.596716 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-91d5e4a3-d058-401d-b193-875a59128815 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:35.597151 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-91d5e4a3-d058-401d-b193-875a59128815 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:35.614219 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-91d5e4a3-d058-401d-b193-875a59128815 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Getting quotas for project 27f98152ab3440cf824c9ceb1c790bcf. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 02:10:35.618341 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-91d5e4a3-d058-401d-b193-875a59128815 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Getting quotas for user 1b43d2b8b9084099b832332a565e741c and project 27f98152ab3440cf824c9ceb1c790bcf. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 02:10:35.629182 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-91d5e4a3-d058-401d-b193-875a59128815 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Going to run 1 instances... {{(pid=117938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 02:10:35.631417 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-91d5e4a3-d058-401d-b193-875a59128815 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: 111070da-9d8e-487a-8e32-60e64894d5a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e648e482-e374-429d-8152-a4a63797f314',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 02:10:35.677206 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-91d5e4a3-d058-401d-b193-875a59128815 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.723927 Jun 08 02:10:35.677853 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 289/590] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jun 8 02:10:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 08 02:10:35.688415 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-388613ae-926d-428e-a4f2-27241892873e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:35.689188 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-388613ae-926d-428e-a4f2-27241892873e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: 111070da-9d8e-487a-8e32-60e64894d5a9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:35.749995 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-388613ae-926d-428e-a4f2-27241892873e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:35.758715 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-388613ae-926d-428e-a4f2-27241892873e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9" status: 200 len: 1237 microversion: 2.1 time: 0.073919 Jun 08 02:10:35.759503 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 302/591] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:10:35 2022] GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9 => generated 1237 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:10:36.776882 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d9f4b5c0-90b8-4e18-945d-1cadc487127f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:36.778019 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d9f4b5c0-90b8-4e18-945d-1cadc487127f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: 111070da-9d8e-487a-8e32-60e64894d5a9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:36.785168 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d9f4b5c0-90b8-4e18-945d-1cadc487127f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:36.785673 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d9f4b5c0-90b8-4e18-945d-1cadc487127f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:36.786418 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d9f4b5c0-90b8-4e18-945d-1cadc487127f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:36.787130 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d9f4b5c0-90b8-4e18-945d-1cadc487127f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:36.856264 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d9f4b5c0-90b8-4e18-945d-1cadc487127f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:36.864163 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d9f4b5c0-90b8-4e18-945d-1cadc487127f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9" status: 200 len: 1307 microversion: 2.1 time: 0.092850 Jun 08 02:10:36.865036 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 290/592] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:10:36 2022] GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9 => generated 1307 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:10:37.881417 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-78210ad7-eab1-4433-9843-b3b752e211fb tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:37.882002 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-78210ad7-eab1-4433-9843-b3b752e211fb tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: 111070da-9d8e-487a-8e32-60e64894d5a9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:37.889940 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-78210ad7-eab1-4433-9843-b3b752e211fb tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:37.890387 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-78210ad7-eab1-4433-9843-b3b752e211fb tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:37.891141 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-78210ad7-eab1-4433-9843-b3b752e211fb tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:37.891596 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-78210ad7-eab1-4433-9843-b3b752e211fb tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:38.121359 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-78210ad7-eab1-4433-9843-b3b752e211fb tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:38.128870 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-78210ad7-eab1-4433-9843-b3b752e211fb tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9" status: 200 len: 1363 microversion: 2.1 time: 0.251302 Jun 08 02:10:38.129433 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 303/593] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:10:37 2022] GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9 => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:10:38.249131 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-1ca0d12a-954f-498c-885e-287faafaeae6 req-92c8ff30-92cc-4fee-a943-b1f0007282ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "111070da-9d8e-487a-8e32-60e64894d5a9", "tag": "a08f634a-054d-4449-a583-749597fcedc6"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:10:38.259780 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-1ca0d12a-954f-498c-885e-287faafaeae6 req-92c8ff30-92cc-4fee-a943-b1f0007282ba service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:38.260581 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-1ca0d12a-954f-498c-885e-287faafaeae6 req-92c8ff30-92cc-4fee-a943-b1f0007282ba service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:38.272960 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-1ca0d12a-954f-498c-885e-287faafaeae6 req-92c8ff30-92cc-4fee-a943-b1f0007282ba service nova] Creating event network-changed:a08f634a-054d-4449-a583-749597fcedc6 for instance 111070da-9d8e-487a-8e32-60e64894d5a9 on hv-cinder-84506 Jun 08 02:10:38.279488 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-1ca0d12a-954f-498c-885e-287faafaeae6 req-92c8ff30-92cc-4fee-a943-b1f0007282ba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034122 Jun 08 02:10:38.280097 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 291/594] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:10:39.145403 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b6b5f28a-baa6-4661-9e31-1e30aa919743 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:39.146003 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-b6b5f28a-baa6-4661-9e31-1e30aa919743 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: 111070da-9d8e-487a-8e32-60e64894d5a9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:39.152707 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b6b5f28a-baa6-4661-9e31-1e30aa919743 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:39.153152 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b6b5f28a-baa6-4661-9e31-1e30aa919743 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:39.153909 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b6b5f28a-baa6-4661-9e31-1e30aa919743 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:39.154363 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b6b5f28a-baa6-4661-9e31-1e30aa919743 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:39.289019 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b6b5f28a-baa6-4661-9e31-1e30aa919743 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:39.297063 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-b6b5f28a-baa6-4661-9e31-1e30aa919743 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9" status: 200 len: 1363 microversion: 2.1 time: 0.155461 Jun 08 02:10:39.297631 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 304/595] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:10:39 2022] GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:10:39.327887 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4824144c-d2ba-4595-90a8-8a16d0b22c6d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:39.328505 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4824144c-d2ba-4595-90a8-8a16d0b22c6d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:39.334738 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4824144c-d2ba-4595-90a8-8a16d0b22c6d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:39.335180 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4824144c-d2ba-4595-90a8-8a16d0b22c6d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:39.335952 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4824144c-d2ba-4595-90a8-8a16d0b22c6d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:39.336686 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4824144c-d2ba-4595-90a8-8a16d0b22c6d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:39.416198 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-4824144c-d2ba-4595-90a8-8a16d0b22c6d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lazy-loading 'services' on Instance uuid 596fe635-9554-4305-b88e-67139f06a3d0 {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 02:10:39.485832 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4824144c-d2ba-4595-90a8-8a16d0b22c6d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "DELETE /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0/os-volume_attachments/2f8b7c34-6efc-40b5-8c74-72b4032f835d" status: 202 len: 0 microversion: 2.1 time: 0.162588 Jun 08 02:10:39.486433 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 292/596] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jun 8 02:10:39 2022] DELETE /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0/os-volume_attachments/2f8b7c34-6efc-40b5-8c74-72b4032f835d => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 02:10:39.495501 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-6b96c9f9-8e56-453c-bf93-70eade567567 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:39.496556 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-6b96c9f9-8e56-453c-bf93-70eade567567 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:39.502518 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6b96c9f9-8e56-453c-bf93-70eade567567 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:39.502963 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6b96c9f9-8e56-453c-bf93-70eade567567 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:39.503723 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6b96c9f9-8e56-453c-bf93-70eade567567 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:39.504151 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6b96c9f9-8e56-453c-bf93-70eade567567 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:39.532429 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-6b96c9f9-8e56-453c-bf93-70eade567567 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041178 Jun 08 02:10:39.532976 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 305/597] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jun 8 02:10:39 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 02:10:40.317752 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-135da06c-9055-4c31-b8f9-f208b25a881d tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:40.318344 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-135da06c-9055-4c31-b8f9-f208b25a881d tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: 111070da-9d8e-487a-8e32-60e64894d5a9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:40.325709 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-135da06c-9055-4c31-b8f9-f208b25a881d tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:40.326154 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-135da06c-9055-4c31-b8f9-f208b25a881d tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:40.327312 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-135da06c-9055-4c31-b8f9-f208b25a881d tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:40.327440 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-135da06c-9055-4c31-b8f9-f208b25a881d tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:40.479641 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-135da06c-9055-4c31-b8f9-f208b25a881d tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:40.487090 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-135da06c-9055-4c31-b8f9-f208b25a881d tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9" status: 200 len: 1363 microversion: 2.1 time: 0.173933 Jun 08 02:10:40.487658 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 293/598] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:10:40 2022] GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:10:40.544044 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e74ee1d7-2175-47d2-8892-297acd042933 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:40.545029 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e74ee1d7-2175-47d2-8892-297acd042933 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:40.551500 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e74ee1d7-2175-47d2-8892-297acd042933 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:40.551952 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e74ee1d7-2175-47d2-8892-297acd042933 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:40.552754 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e74ee1d7-2175-47d2-8892-297acd042933 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:40.553190 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e74ee1d7-2175-47d2-8892-297acd042933 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:40.581381 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e74ee1d7-2175-47d2-8892-297acd042933 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041809 Jun 08 02:10:40.581857 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 306/599] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jun 8 02:10:40 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 08 02:10:40.661872 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-bfc2b801-8974-4e8e-a2c0-25323cdbe93a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:40.662353 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-bfc2b801-8974-4e8e-a2c0-25323cdbe93a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:40.669131 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bfc2b801-8974-4e8e-a2c0-25323cdbe93a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:40.669575 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bfc2b801-8974-4e8e-a2c0-25323cdbe93a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:40.670326 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bfc2b801-8974-4e8e-a2c0-25323cdbe93a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:40.670754 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bfc2b801-8974-4e8e-a2c0-25323cdbe93a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:40.694979 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-bfc2b801-8974-4e8e-a2c0-25323cdbe93a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Going to try to terminate instance {{(pid=117938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 02:10:40.770937 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-bfc2b801-8974-4e8e-a2c0-25323cdbe93a tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "DELETE /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 204 len: 0 microversion: 2.1 time: 0.112921 Jun 08 02:10:40.772008 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 294/600] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jun 8 02:10:40 2022] DELETE /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 08 02:10:40.780916 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f1e29f7f-44ca-4b66-b196-432c6323335c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:40.781527 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f1e29f7f-44ca-4b66-b196-432c6323335c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:40.787752 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f1e29f7f-44ca-4b66-b196-432c6323335c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:40.788207 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f1e29f7f-44ca-4b66-b196-432c6323335c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:40.789019 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f1e29f7f-44ca-4b66-b196-432c6323335c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:40.790025 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f1e29f7f-44ca-4b66-b196-432c6323335c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:40.917815 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f1e29f7f-44ca-4b66-b196-432c6323335c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:40.925459 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f1e29f7f-44ca-4b66-b196-432c6323335c tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1689 microversion: 2.1 time: 0.148428 Jun 08 02:10:40.926015 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 307/601] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:10:40 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:10:41.504465 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-21051109-2c05-4e52-8ff6-c70472ee68b0 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:41.505165 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-21051109-2c05-4e52-8ff6-c70472ee68b0 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: 111070da-9d8e-487a-8e32-60e64894d5a9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:41.511831 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-21051109-2c05-4e52-8ff6-c70472ee68b0 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:41.512282 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-21051109-2c05-4e52-8ff6-c70472ee68b0 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:41.513138 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-21051109-2c05-4e52-8ff6-c70472ee68b0 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:41.513573 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-21051109-2c05-4e52-8ff6-c70472ee68b0 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:41.640196 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-21051109-2c05-4e52-8ff6-c70472ee68b0 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:41.647442 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-21051109-2c05-4e52-8ff6-c70472ee68b0 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9" status: 200 len: 1363 microversion: 2.1 time: 0.147238 Jun 08 02:10:41.648000 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 295/602] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:10:41 2022] GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:10:41.948614 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-95b7da98-f2f8-47de-88da-e6ecfa947389 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:41.949223 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-95b7da98-f2f8-47de-88da-e6ecfa947389 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:41.955702 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-95b7da98-f2f8-47de-88da-e6ecfa947389 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:41.956153 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-95b7da98-f2f8-47de-88da-e6ecfa947389 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:41.956942 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-95b7da98-f2f8-47de-88da-e6ecfa947389 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:41.957376 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-95b7da98-f2f8-47de-88da-e6ecfa947389 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:42.095848 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-95b7da98-f2f8-47de-88da-e6ecfa947389 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:42.103470 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-95b7da98-f2f8-47de-88da-e6ecfa947389 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1689 microversion: 2.1 time: 0.159397 Jun 08 02:10:42.104280 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 308/603] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:10:41 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:10:42.665129 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b7056bad-f9cf-4050-8f91-db76ceeb604a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:42.665731 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b7056bad-f9cf-4050-8f91-db76ceeb604a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: 111070da-9d8e-487a-8e32-60e64894d5a9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:42.672432 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b7056bad-f9cf-4050-8f91-db76ceeb604a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:42.672883 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b7056bad-f9cf-4050-8f91-db76ceeb604a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:42.673641 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b7056bad-f9cf-4050-8f91-db76ceeb604a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:42.674074 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b7056bad-f9cf-4050-8f91-db76ceeb604a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:42.800135 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b7056bad-f9cf-4050-8f91-db76ceeb604a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:42.807600 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b7056bad-f9cf-4050-8f91-db76ceeb604a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9" status: 200 len: 1363 microversion: 2.1 time: 0.146332 Jun 08 02:10:42.808160 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 296/604] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:10:42 2022] GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:10:43.120297 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-fbb4632d-a5a9-4925-820a-7d46e1555c6b tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:43.120935 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-fbb4632d-a5a9-4925-820a-7d46e1555c6b tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:43.127415 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fbb4632d-a5a9-4925-820a-7d46e1555c6b tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:43.127860 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fbb4632d-a5a9-4925-820a-7d46e1555c6b tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:43.128655 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fbb4632d-a5a9-4925-820a-7d46e1555c6b tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:43.129090 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fbb4632d-a5a9-4925-820a-7d46e1555c6b tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:43.261634 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-fbb4632d-a5a9-4925-820a-7d46e1555c6b tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:43.269725 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-fbb4632d-a5a9-4925-820a-7d46e1555c6b tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1689 microversion: 2.1 time: 0.153216 Jun 08 02:10:43.270297 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 309/605] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:10:43 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:10:43.825104 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3fe7529a-cfe3-4b58-94c5-e7ec0f2f9454 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:43.825674 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3fe7529a-cfe3-4b58-94c5-e7ec0f2f9454 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: 111070da-9d8e-487a-8e32-60e64894d5a9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:43.832136 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3fe7529a-cfe3-4b58-94c5-e7ec0f2f9454 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:43.832615 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3fe7529a-cfe3-4b58-94c5-e7ec0f2f9454 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:43.833372 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3fe7529a-cfe3-4b58-94c5-e7ec0f2f9454 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:43.833806 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3fe7529a-cfe3-4b58-94c5-e7ec0f2f9454 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:43.963035 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3fe7529a-cfe3-4b58-94c5-e7ec0f2f9454 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:43.970312 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3fe7529a-cfe3-4b58-94c5-e7ec0f2f9454 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9" status: 200 len: 1363 microversion: 2.1 time: 0.149933 Jun 08 02:10:43.970873 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 297/606] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:10:43 2022] GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:10:44.287325 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-daa73693-8eb1-4225-a97a-9d4fa3aa1c73 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:44.287928 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-daa73693-8eb1-4225-a97a-9d4fa3aa1c73 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:44.294882 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-daa73693-8eb1-4225-a97a-9d4fa3aa1c73 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:44.295367 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-daa73693-8eb1-4225-a97a-9d4fa3aa1c73 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:44.296236 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-daa73693-8eb1-4225-a97a-9d4fa3aa1c73 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:44.296829 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-daa73693-8eb1-4225-a97a-9d4fa3aa1c73 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:44.448426 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-daa73693-8eb1-4225-a97a-9d4fa3aa1c73 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:44.455796 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-daa73693-8eb1-4225-a97a-9d4fa3aa1c73 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1689 microversion: 2.1 time: 0.172313 Jun 08 02:10:44.456361 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 310/607] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:10:44 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:10:44.987431 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9c8b68d1-1e01-4d0d-a1c0-eb5d2e66313f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:44.988092 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9c8b68d1-1e01-4d0d-a1c0-eb5d2e66313f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: 111070da-9d8e-487a-8e32-60e64894d5a9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:44.995438 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9c8b68d1-1e01-4d0d-a1c0-eb5d2e66313f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:44.995882 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9c8b68d1-1e01-4d0d-a1c0-eb5d2e66313f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:44.996661 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9c8b68d1-1e01-4d0d-a1c0-eb5d2e66313f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:44.997090 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9c8b68d1-1e01-4d0d-a1c0-eb5d2e66313f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:45.198329 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9c8b68d1-1e01-4d0d-a1c0-eb5d2e66313f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:45.206307 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9c8b68d1-1e01-4d0d-a1c0-eb5d2e66313f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9" status: 200 len: 1363 microversion: 2.1 time: 0.222882 Jun 08 02:10:45.207159 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 298/608] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:10:44 2022] GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:10:45.244670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-9744bebb-d018-480c-b429-8c878110dba0 req-ed2a2d34-dd7f-48a5-b7f2-639f55092c35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "111070da-9d8e-487a-8e32-60e64894d5a9", "name": "network-vif-plugged", "status": "completed", "tag": "a08f634a-054d-4449-a583-749597fcedc6"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:10:45.253815 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-9744bebb-d018-480c-b429-8c878110dba0 req-ed2a2d34-dd7f-48a5-b7f2-639f55092c35 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:45.254255 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-9744bebb-d018-480c-b429-8c878110dba0 req-ed2a2d34-dd7f-48a5-b7f2-639f55092c35 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:45.266102 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-9744bebb-d018-480c-b429-8c878110dba0 req-ed2a2d34-dd7f-48a5-b7f2-639f55092c35 service nova] Creating event network-vif-plugged:a08f634a-054d-4449-a583-749597fcedc6 for instance 111070da-9d8e-487a-8e32-60e64894d5a9 on hv-cinder-84506 Jun 08 02:10:45.270869 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-9744bebb-d018-480c-b429-8c878110dba0 req-ed2a2d34-dd7f-48a5-b7f2-639f55092c35 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030141 Jun 08 02:10:45.271548 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 311/609] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:10:45.330546 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-df3d1980-0320-46a8-88e5-c68ee6b84d1b req-93bfc09c-fc46-4bcb-8686-506733c87a15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "596fe635-9554-4305-b88e-67139f06a3d0", "name": "network-vif-deleted", "tag": "d96f59a2-4ec1-4327-b308-e50814a9bbc5"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:10:45.345864 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-df3d1980-0320-46a8-88e5-c68ee6b84d1b req-93bfc09c-fc46-4bcb-8686-506733c87a15 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:45.346644 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-df3d1980-0320-46a8-88e5-c68ee6b84d1b req-93bfc09c-fc46-4bcb-8686-506733c87a15 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:45.369834 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-df3d1980-0320-46a8-88e5-c68ee6b84d1b req-93bfc09c-fc46-4bcb-8686-506733c87a15 service nova] Creating event network-vif-deleted:d96f59a2-4ec1-4327-b308-e50814a9bbc5 for instance 596fe635-9554-4305-b88e-67139f06a3d0 on hv-cinder-84506 Jun 08 02:10:45.375799 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-df3d1980-0320-46a8-88e5-c68ee6b84d1b req-93bfc09c-fc46-4bcb-8686-506733c87a15 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049516 Jun 08 02:10:45.378557 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 299/610] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:10:45.473712 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-428db9d1-bb8e-4ea4-b094-52cbdf5f952d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:45.474398 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-428db9d1-bb8e-4ea4-b094-52cbdf5f952d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:45.485225 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-428db9d1-bb8e-4ea4-b094-52cbdf5f952d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:45.485954 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-428db9d1-bb8e-4ea4-b094-52cbdf5f952d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:45.486925 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-428db9d1-bb8e-4ea4-b094-52cbdf5f952d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:45.487513 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-428db9d1-bb8e-4ea4-b094-52cbdf5f952d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:45.526820 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-428db9d1-bb8e-4ea4-b094-52cbdf5f952d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:45.527261 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-428db9d1-bb8e-4ea4-b094-52cbdf5f952d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:45.527705 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.objects.instance [None req-428db9d1-bb8e-4ea4-b094-52cbdf5f952d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lazy-loading 'fault' on Instance uuid 596fe635-9554-4305-b88e-67139f06a3d0 {{(pid=117939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 02:10:45.577233 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-428db9d1-bb8e-4ea4-b094-52cbdf5f952d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:45.584640 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-428db9d1-bb8e-4ea4-b094-52cbdf5f952d tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 200 len: 1335 microversion: 2.1 time: 0.115679 Jun 08 02:10:45.585421 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 312/611] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:10:45 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 1335 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:10:46.220676 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:10:46.221426 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=10 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:10:46.227415 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d16409de-9da2-4792-bfaa-bb03bc5d4714 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:46.228331 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d16409de-9da2-4792-bfaa-bb03bc5d4714 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: 111070da-9d8e-487a-8e32-60e64894d5a9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:46.235604 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d16409de-9da2-4792-bfaa-bb03bc5d4714 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:46.236045 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d16409de-9da2-4792-bfaa-bb03bc5d4714 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:46.236856 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d16409de-9da2-4792-bfaa-bb03bc5d4714 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:46.237288 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d16409de-9da2-4792-bfaa-bb03bc5d4714 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:46.381501 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d16409de-9da2-4792-bfaa-bb03bc5d4714 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:46.389418 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d16409de-9da2-4792-bfaa-bb03bc5d4714 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9" status: 200 len: 1363 microversion: 2.1 time: 0.169653 Jun 08 02:10:46.390007 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 300/612] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:10:46 2022] GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:10:46.601826 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d9110b13-a930-4374-b6db-777181547fbe tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:46.602446 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d9110b13-a930-4374-b6db-777181547fbe tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: 596fe635-9554-4305-b88e-67139f06a3d0] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:46.604369 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=2 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:10:46.610124 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d9110b13-a930-4374-b6db-777181547fbe tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:46.610570 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d9110b13-a930-4374-b6db-777181547fbe tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:46.611328 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d9110b13-a930-4374-b6db-777181547fbe tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:46.611761 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d9110b13-a930-4374-b6db-777181547fbe tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:46.624686 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-d9110b13-a930-4374-b6db-777181547fbe tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] HTTP exception thrown: Instance 596fe635-9554-4305-b88e-67139f06a3d0 could not be found. Jun 08 02:10:46.626273 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d9110b13-a930-4374-b6db-777181547fbe tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Request method failure captured: Jun 08 02:10:46.626273 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 HTTP/1.1 Jun 08 02:10:46.626273 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept: application/json Jun 08 02:10:46.626273 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jun 08 02:10:46.626273 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Connection: close Jun 08 02:10:46.626273 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jun 08 02:10:46.626273 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jun 08 02:10:46.626273 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Host: 10.222.0.20 Jun 08 02:10:46.626273 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jun 08 02:10:46.626273 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jun 08 02:10:46.626273 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABioAPv8gMotrJlZTFwglagYqckJEX1fLvg2vCOIJVfZx23pLMKwu0kMosHU2TJEE42L3PHJCygQBsaqUei7q2GmAE1OvpdyyA2K6f4U-qDG0gFChJCyiiFe6KgYhekG7cdzFKfmztAXfzdnIapCZ5hWCdvq58rcVhDFHy9z0kDGo3H5gg Jun 08 02:10:46.626273 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jun 08 02:10:46.626273 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jun 08 02:10:46.626273 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jun 08 02:10:46.626273 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jun 08 02:10:46.626273 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jun 08 02:10:46.626273 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jun 08 02:10:46.626273 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Id: d40d753f66ec4ed2808aa65b825e66f8 Jun 08 02:10:46.626273 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-237519543 Jun 08 02:10:46.626273 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jun 08 02:10:46.626273 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jun 08 02:10:46.627799 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d40d753f66ec4ed2808aa65b825e66f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d40d753f66ec4ed2808aa65b825e66f8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d40d753f66ec4ed2808aa65b825e66f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d40d753f66ec4ed2808aa65b825e66f8"}]}] Jun 08 02:10:46.627799 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-ServerRescueNegativeTestJSON-237519543 Jun 08 02:10:46.627799 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Id: d40d753f66ec4ed2808aa65b825e66f8 Jun 08 02:10:46.627799 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-237519543 Jun 08 02:10:46.627799 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User: tempest-ServerRescueNegativeTestJSON-237519543-project Jun 08 02:10:46.627799 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jun 08 02:10:46.627799 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jun 08 02:10:46.627799 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Id: 9e13bd970d2e4d67b62452ae0d6cae56 Jun 08 02:10:46.627799 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-ServerRescueNegativeTestJSON-237519543-project Jun 08 02:10:46.627799 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: method: > Jun 08 02:10:46.627799 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: exception: Instance 596fe635-9554-4305-b88e-67139f06a3d0 could not be found. Jun 08 02:10:46.627799 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: action_args: {'id': '596fe635-9554-4305-b88e-67139f06a3d0'} Jun 08 02:10:46.628706 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:10:46.628706 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:10:46.628706 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:10:46.628706 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:10:46.628706 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:10:46.628706 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:10:46.628706 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:10:46.628706 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:10:46.628706 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:10:46.628706 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:10:46.628706 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 596fe635-9554-4305-b88e-67139f06a3d0 could not be found. Jun 08 02:10:46.628706 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:10:46.628706 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:10:46.628706 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:10:46.628706 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:10:46.628706 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:10:46.628706 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:10:46.628706 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:10:46.628706 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:10:46.628706 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:10:46.630226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:10:46.630226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 02:10:46.630226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 02:10:46.630226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:10:46.630226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:10:46.630226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:10:46.630226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:10:46.630226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 596fe635-9554-4305-b88e-67139f06a3d0 could not be found. Jun 08 02:10:46.630226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:10:46.630226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:10:46.630226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:10:46.630226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:10:46.630226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:10:46.630226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:10:46.630226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:10:46.630226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:10:46.630226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 596fe635-9554-4305-b88e-67139f06a3d0 could not be found. Jun 08 02:10:46.630226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:10:46.631477 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d9110b13-a930-4374-b6db-777181547fbe tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Returning 404 to user: Instance 596fe635-9554-4305-b88e-67139f06a3d0 could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:10:46.631477 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d9110b13-a930-4374-b6db-777181547fbe tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0" status: 404 len: 111 microversion: 2.1 time: 0.029919 Jun 08 02:10:46.631477 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 313/613] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:10:46 2022] GET /compute/v2.1/servers/596fe635-9554-4305-b88e-67139f06a3d0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 02:10:46.636887 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1e74536f-a654-491b-98c1-23854046f7f8 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '.version_select at 0x7f836aed5550>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:46.653829 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1e74536f-a654-491b-98c1-23854046f7f8 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-883393138" status: 202 len: 0 microversion: 2.1 time: 0.021496 Jun 08 02:10:46.654404 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 301/614] 10.222.0.20 () {58 vars in 1217 bytes} [Wed Jun 8 02:10:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-883393138 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 02:10:47.406869 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a51cd6d7-6b7b-4b6f-bb6e-6fdc2f4f91f7 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:47.407470 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a51cd6d7-6b7b-4b6f-bb6e-6fdc2f4f91f7 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: 111070da-9d8e-487a-8e32-60e64894d5a9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:47.420820 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a51cd6d7-6b7b-4b6f-bb6e-6fdc2f4f91f7 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:47.422543 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a51cd6d7-6b7b-4b6f-bb6e-6fdc2f4f91f7 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:47.423402 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a51cd6d7-6b7b-4b6f-bb6e-6fdc2f4f91f7 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:47.425889 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a51cd6d7-6b7b-4b6f-bb6e-6fdc2f4f91f7 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:47.580406 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a51cd6d7-6b7b-4b6f-bb6e-6fdc2f4f91f7 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:47.588231 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a51cd6d7-6b7b-4b6f-bb6e-6fdc2f4f91f7 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9" status: 200 len: 1550 microversion: 2.1 time: 0.185449 Jun 08 02:10:47.588958 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 314/615] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:10:47 2022] GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9 => generated 1550 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:10:47.605392 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b1a1d160-f0c2-4c81-b7ed-9b62b6319f2b tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:47.605938 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b1a1d160-f0c2-4c81-b7ed-9b62b6319f2b tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: 111070da-9d8e-487a-8e32-60e64894d5a9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:47.612676 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b1a1d160-f0c2-4c81-b7ed-9b62b6319f2b tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:47.612981 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b1a1d160-f0c2-4c81-b7ed-9b62b6319f2b tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:47.613751 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b1a1d160-f0c2-4c81-b7ed-9b62b6319f2b tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:47.614185 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b1a1d160-f0c2-4c81-b7ed-9b62b6319f2b tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:47.693683 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b1a1d160-f0c2-4c81-b7ed-9b62b6319f2b tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092804 Jun 08 02:10:47.694344 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 302/616] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jun 8 02:10:47 2022] GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:10:48.667026 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-0b747c71-143b-4d17-8837-f512af5eaf09 req-1dc4d8eb-c7b9-4d68-9d53-a0004d5c3459 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "111070da-9d8e-487a-8e32-60e64894d5a9", "tag": "a08f634a-054d-4449-a583-749597fcedc6"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:10:48.675558 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-0b747c71-143b-4d17-8837-f512af5eaf09 req-1dc4d8eb-c7b9-4d68-9d53-a0004d5c3459 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:48.676134 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-0b747c71-143b-4d17-8837-f512af5eaf09 req-1dc4d8eb-c7b9-4d68-9d53-a0004d5c3459 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:48.688817 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-0b747c71-143b-4d17-8837-f512af5eaf09 req-1dc4d8eb-c7b9-4d68-9d53-a0004d5c3459 service nova] Creating event network-changed:a08f634a-054d-4449-a583-749597fcedc6 for instance 111070da-9d8e-487a-8e32-60e64894d5a9 on hv-cinder-84506 Jun 08 02:10:48.695335 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-0b747c71-143b-4d17-8837-f512af5eaf09 req-1dc4d8eb-c7b9-4d68-9d53-a0004d5c3459 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100155 Jun 08 02:10:48.697186 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 315/617] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:10:49.801409 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9e16f20a-63b4-4c9a-a14a-e20725a6613b tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:49.801899 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9e16f20a-63b4-4c9a-a14a-e20725a6613b tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:49.808893 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9e16f20a-63b4-4c9a-a14a-e20725a6613b tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:49.809337 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9e16f20a-63b4-4c9a-a14a-e20725a6613b tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:49.810094 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9e16f20a-63b4-4c9a-a14a-e20725a6613b tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:49.810527 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9e16f20a-63b4-4c9a-a14a-e20725a6613b tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:49.834346 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9e16f20a-63b4-4c9a-a14a-e20725a6613b tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Going to try to terminate instance {{(pid=117938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 02:10:49.847637 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:10:49.909086 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9e16f20a-63b4-4c9a-a14a-e20725a6613b tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "DELETE /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 204 len: 0 microversion: 2.1 time: 0.110780 Jun 08 02:10:49.909086 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 303/618] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jun 8 02:10:49 2022] DELETE /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 08 02:10:49.921771 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c5250521-7c91-48dc-8bfc-98752b3e5d63 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:49.923239 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c5250521-7c91-48dc-8bfc-98752b3e5d63 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:49.930669 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c5250521-7c91-48dc-8bfc-98752b3e5d63 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:49.931189 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c5250521-7c91-48dc-8bfc-98752b3e5d63 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:49.932029 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c5250521-7c91-48dc-8bfc-98752b3e5d63 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:49.932587 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c5250521-7c91-48dc-8bfc-98752b3e5d63 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:50.059664 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c5250521-7c91-48dc-8bfc-98752b3e5d63 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:50.067091 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c5250521-7c91-48dc-8bfc-98752b3e5d63 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1508 microversion: 2.1 time: 0.152258 Jun 08 02:10:50.067637 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 316/619] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:10:49 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:10:51.085321 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c4173daf-339e-4a3d-b879-a21ebe33a344 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:51.086047 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c4173daf-339e-4a3d-b879-a21ebe33a344 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:51.092542 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c4173daf-339e-4a3d-b879-a21ebe33a344 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:51.092996 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c4173daf-339e-4a3d-b879-a21ebe33a344 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:51.093781 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c4173daf-339e-4a3d-b879-a21ebe33a344 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:51.094216 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c4173daf-339e-4a3d-b879-a21ebe33a344 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:51.225653 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c4173daf-339e-4a3d-b879-a21ebe33a344 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:51.233827 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c4173daf-339e-4a3d-b879-a21ebe33a344 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1508 microversion: 2.1 time: 0.152724 Jun 08 02:10:51.234386 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 304/620] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:10:51 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:10:52.251013 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e38252e7-6f07-43ad-a4cb-fc3f8d0c1dfc tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:52.251649 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e38252e7-6f07-43ad-a4cb-fc3f8d0c1dfc tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:52.258925 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e38252e7-6f07-43ad-a4cb-fc3f8d0c1dfc tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:52.259376 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e38252e7-6f07-43ad-a4cb-fc3f8d0c1dfc tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:52.260138 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e38252e7-6f07-43ad-a4cb-fc3f8d0c1dfc tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:52.260605 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e38252e7-6f07-43ad-a4cb-fc3f8d0c1dfc tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:52.427466 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e38252e7-6f07-43ad-a4cb-fc3f8d0c1dfc tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:52.435693 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e38252e7-6f07-43ad-a4cb-fc3f8d0c1dfc tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 200 len: 1508 microversion: 2.1 time: 0.188590 Jun 08 02:10:52.436260 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 317/621] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:10:52 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 1508 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:10:52.828530 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-b55172c3-6f7c-45c3-ba38-2d3efd588953 req-e2d8f30f-62bb-4672-b121-ce40f93839ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb925141-6220-42fb-acfe-098906d06f8b", "name": "network-vif-deleted", "tag": "854f4972-75d1-4f33-b863-4ac1e9184f71"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:10:52.838347 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-b55172c3-6f7c-45c3-ba38-2d3efd588953 req-e2d8f30f-62bb-4672-b121-ce40f93839ba service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:52.838805 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-b55172c3-6f7c-45c3-ba38-2d3efd588953 req-e2d8f30f-62bb-4672-b121-ce40f93839ba service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:52.850692 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-b55172c3-6f7c-45c3-ba38-2d3efd588953 req-e2d8f30f-62bb-4672-b121-ce40f93839ba service nova] Creating event network-vif-deleted:854f4972-75d1-4f33-b863-4ac1e9184f71 for instance eb925141-6220-42fb-acfe-098906d06f8b on hv-cinder-84506 Jun 08 02:10:52.856430 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-b55172c3-6f7c-45c3-ba38-2d3efd588953 req-e2d8f30f-62bb-4672-b121-ce40f93839ba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032244 Jun 08 02:10:52.857318 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 305/622] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:10:53.452211 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-9a5fd8ca-b0a2-4d4f-8f5c-ff8af7540ab4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:53.452845 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-9a5fd8ca-b0a2-4d4f-8f5c-ff8af7540ab4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: eb925141-6220-42fb-acfe-098906d06f8b] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:53.455429 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:10:53.463573 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9a5fd8ca-b0a2-4d4f-8f5c-ff8af7540ab4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:53.464019 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9a5fd8ca-b0a2-4d4f-8f5c-ff8af7540ab4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:53.464815 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9a5fd8ca-b0a2-4d4f-8f5c-ff8af7540ab4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:53.465248 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9a5fd8ca-b0a2-4d4f-8f5c-ff8af7540ab4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:53.480191 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-9a5fd8ca-b0a2-4d4f-8f5c-ff8af7540ab4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] HTTP exception thrown: Instance eb925141-6220-42fb-acfe-098906d06f8b could not be found. Jun 08 02:10:53.482006 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-9a5fd8ca-b0a2-4d4f-8f5c-ff8af7540ab4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Request method failure captured: Jun 08 02:10:53.482006 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b HTTP/1.1 Jun 08 02:10:53.482006 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept: application/json Jun 08 02:10:53.482006 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jun 08 02:10:53.482006 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Connection: close Jun 08 02:10:53.482006 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jun 08 02:10:53.482006 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jun 08 02:10:53.482006 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Host: 10.222.0.20 Jun 08 02:10:53.482006 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jun 08 02:10:53.482006 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jun 08 02:10:53.482006 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABioAPv8gMotrJlZTFwglagYqckJEX1fLvg2vCOIJVfZx23pLMKwu0kMosHU2TJEE42L3PHJCygQBsaqUei7q2GmAE1OvpdyyA2K6f4U-qDG0gFChJCyiiFe6KgYhekG7cdzFKfmztAXfzdnIapCZ5hWCdvq58rcVhDFHy9z0kDGo3H5gg Jun 08 02:10:53.482006 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jun 08 02:10:53.482006 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jun 08 02:10:53.482006 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jun 08 02:10:53.482006 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jun 08 02:10:53.482006 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jun 08 02:10:53.482006 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jun 08 02:10:53.482006 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Id: d40d753f66ec4ed2808aa65b825e66f8 Jun 08 02:10:53.482006 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-237519543 Jun 08 02:10:53.482006 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jun 08 02:10:53.482006 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jun 08 02:10:53.483591 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d40d753f66ec4ed2808aa65b825e66f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d40d753f66ec4ed2808aa65b825e66f8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d40d753f66ec4ed2808aa65b825e66f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d40d753f66ec4ed2808aa65b825e66f8"}]}] Jun 08 02:10:53.483591 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-ServerRescueNegativeTestJSON-237519543 Jun 08 02:10:53.483591 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Id: d40d753f66ec4ed2808aa65b825e66f8 Jun 08 02:10:53.483591 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-237519543 Jun 08 02:10:53.483591 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User: tempest-ServerRescueNegativeTestJSON-237519543-project Jun 08 02:10:53.483591 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jun 08 02:10:53.483591 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jun 08 02:10:53.483591 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Id: 9e13bd970d2e4d67b62452ae0d6cae56 Jun 08 02:10:53.483591 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-ServerRescueNegativeTestJSON-237519543-project Jun 08 02:10:53.483591 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: method: > Jun 08 02:10:53.483591 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: exception: Instance eb925141-6220-42fb-acfe-098906d06f8b could not be found. Jun 08 02:10:53.483591 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: action_args: {'id': 'eb925141-6220-42fb-acfe-098906d06f8b'} Jun 08 02:10:53.484503 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:10:53.484503 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:10:53.484503 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:10:53.484503 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:10:53.484503 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:10:53.484503 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:10:53.484503 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:10:53.484503 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:10:53.484503 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:10:53.484503 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:10:53.484503 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb925141-6220-42fb-acfe-098906d06f8b could not be found. Jun 08 02:10:53.484503 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:10:53.484503 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:10:53.484503 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:10:53.484503 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:10:53.484503 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:10:53.484503 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:10:53.484503 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:10:53.484503 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:10:53.484503 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:10:53.485960 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:10:53.485960 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 02:10:53.485960 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 02:10:53.485960 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:10:53.485960 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:10:53.485960 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:10:53.485960 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:10:53.485960 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb925141-6220-42fb-acfe-098906d06f8b could not be found. Jun 08 02:10:53.485960 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:10:53.485960 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:10:53.485960 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:10:53.485960 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:10:53.485960 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:10:53.485960 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:10:53.485960 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:10:53.485960 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:10:53.485960 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb925141-6220-42fb-acfe-098906d06f8b could not be found. Jun 08 02:10:53.485960 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:10:53.487260 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-9a5fd8ca-b0a2-4d4f-8f5c-ff8af7540ab4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Returning 404 to user: Instance eb925141-6220-42fb-acfe-098906d06f8b could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:10:53.487260 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-9a5fd8ca-b0a2-4d4f-8f5c-ff8af7540ab4 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b" status: 404 len: 111 microversion: 2.1 time: 0.035490 Jun 08 02:10:53.487260 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 318/623] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:10:53 2022] GET /compute/v2.1/servers/eb925141-6220-42fb-acfe-098906d06f8b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 08 02:10:53.493304 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f0bd8e01-d745-4a60-ae76-64e2ff016bf0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:53.493902 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f0bd8e01-d745-4a60-ae76-64e2ff016bf0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:53.495845 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:10:53.501409 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f0bd8e01-d745-4a60-ae76-64e2ff016bf0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:53.501860 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f0bd8e01-d745-4a60-ae76-64e2ff016bf0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:53.502629 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f0bd8e01-d745-4a60-ae76-64e2ff016bf0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:53.503061 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f0bd8e01-d745-4a60-ae76-64e2ff016bf0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:53.537026 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f0bd8e01-d745-4a60-ae76-64e2ff016bf0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Going to try to terminate instance {{(pid=117938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 02:10:53.624673 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f0bd8e01-d745-4a60-ae76-64e2ff016bf0 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 204 len: 0 microversion: 2.1 time: 0.135383 Jun 08 02:10:53.625267 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 306/624] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jun 8 02:10:53 2022] DELETE /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 08 02:10:53.634948 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-db8fce4e-6a2c-423e-9722-6bbef78e3a04 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:53.634948 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-db8fce4e-6a2c-423e-9722-6bbef78e3a04 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:53.641168 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-db8fce4e-6a2c-423e-9722-6bbef78e3a04 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:53.641844 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-db8fce4e-6a2c-423e-9722-6bbef78e3a04 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:53.643181 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-db8fce4e-6a2c-423e-9722-6bbef78e3a04 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:53.643644 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-db8fce4e-6a2c-423e-9722-6bbef78e3a04 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:53.801645 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-db8fce4e-6a2c-423e-9722-6bbef78e3a04 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:53.814586 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-db8fce4e-6a2c-423e-9722-6bbef78e3a04 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1522 microversion: 2.1 time: 0.183802 Jun 08 02:10:53.814586 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 319/625] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:10:53 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:10:54.832155 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-12c276ba-4cd9-493a-a5d9-09f05046d8c8 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:54.832863 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-12c276ba-4cd9-493a-a5d9-09f05046d8c8 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:54.839995 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-12c276ba-4cd9-493a-a5d9-09f05046d8c8 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:54.840471 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-12c276ba-4cd9-493a-a5d9-09f05046d8c8 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:54.841221 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-12c276ba-4cd9-493a-a5d9-09f05046d8c8 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:54.841651 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-12c276ba-4cd9-493a-a5d9-09f05046d8c8 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:54.971988 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-12c276ba-4cd9-493a-a5d9-09f05046d8c8 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:54.979338 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-12c276ba-4cd9-493a-a5d9-09f05046d8c8 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1522 microversion: 2.1 time: 0.151387 Jun 08 02:10:54.979904 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 307/626] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:10:54 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:10:55.997335 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-6e35b38e-fc9c-4698-ab21-519daec2b07e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:55.997944 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-6e35b38e-fc9c-4698-ab21-519daec2b07e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:56.004717 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6e35b38e-fc9c-4698-ab21-519daec2b07e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:56.005176 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6e35b38e-fc9c-4698-ab21-519daec2b07e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:56.005946 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6e35b38e-fc9c-4698-ab21-519daec2b07e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:56.006381 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6e35b38e-fc9c-4698-ab21-519daec2b07e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:56.009707 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=100 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:10:56.135047 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-6e35b38e-fc9c-4698-ab21-519daec2b07e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:56.142506 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-6e35b38e-fc9c-4698-ab21-519daec2b07e tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1522 microversion: 2.1 time: 0.149044 Jun 08 02:10:56.143058 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 320/627] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:10:55 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:10:57.159230 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-41227eaa-fe3e-4484-a0fa-0065d8577530 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:57.159961 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-41227eaa-fe3e-4484-a0fa-0065d8577530 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:57.167808 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-41227eaa-fe3e-4484-a0fa-0065d8577530 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:57.168367 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-41227eaa-fe3e-4484-a0fa-0065d8577530 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:57.169231 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-41227eaa-fe3e-4484-a0fa-0065d8577530 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:57.169750 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-41227eaa-fe3e-4484-a0fa-0065d8577530 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:57.387851 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-41227eaa-fe3e-4484-a0fa-0065d8577530 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e13bd970d2e4d67b62452ae0d6cae56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40d753f66ec4ed2808aa65b825e66f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:10:57.396097 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-41227eaa-fe3e-4484-a0fa-0065d8577530 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 200 len: 1522 microversion: 2.1 time: 0.240946 Jun 08 02:10:57.396714 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 308/628] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:10:57 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:10:57.604944 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-10d37846-5035-413d-8248-e96ef90fad25 req-76b725c1-16f3-470d-9421-b3e7e316bd45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4fe47a1-fdef-478e-94c7-42b5945a57ae", "name": "network-vif-deleted", "tag": "895ce244-87ef-415a-88d2-f764d9932c90"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:10:57.616291 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-10d37846-5035-413d-8248-e96ef90fad25 req-76b725c1-16f3-470d-9421-b3e7e316bd45 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:57.616730 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-10d37846-5035-413d-8248-e96ef90fad25 req-76b725c1-16f3-470d-9421-b3e7e316bd45 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:57.628749 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-10d37846-5035-413d-8248-e96ef90fad25 req-76b725c1-16f3-470d-9421-b3e7e316bd45 service nova] Creating event network-vif-deleted:895ce244-87ef-415a-88d2-f764d9932c90 for instance f4fe47a1-fdef-478e-94c7-42b5945a57ae on hv-cinder-84506 Jun 08 02:10:57.633866 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-10d37846-5035-413d-8248-e96ef90fad25 req-76b725c1-16f3-470d-9421-b3e7e316bd45 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033340 Jun 08 02:10:57.634446 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 321/629] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:10:58.415075 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2bb55b5b-330f-42ce-98f0-bf7810de6e27 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:10:58.415683 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2bb55b5b-330f-42ce-98f0-bf7810de6e27 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] [instance: f4fe47a1-fdef-478e-94c7-42b5945a57ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:10:58.422177 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2bb55b5b-330f-42ce-98f0-bf7810de6e27 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:58.422624 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2bb55b5b-330f-42ce-98f0-bf7810de6e27 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:58.423383 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2bb55b5b-330f-42ce-98f0-bf7810de6e27 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:10:58.423824 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2bb55b5b-330f-42ce-98f0-bf7810de6e27 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:10:58.437318 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-2bb55b5b-330f-42ce-98f0-bf7810de6e27 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] HTTP exception thrown: Instance f4fe47a1-fdef-478e-94c7-42b5945a57ae could not be found. Jun 08 02:10:58.438924 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2bb55b5b-330f-42ce-98f0-bf7810de6e27 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Request method failure captured: Jun 08 02:10:58.438924 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae HTTP/1.1 Jun 08 02:10:58.438924 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept: application/json Jun 08 02:10:58.438924 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jun 08 02:10:58.438924 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Connection: close Jun 08 02:10:58.438924 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jun 08 02:10:58.438924 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jun 08 02:10:58.438924 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Host: 10.222.0.20 Jun 08 02:10:58.438924 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jun 08 02:10:58.438924 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jun 08 02:10:58.438924 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABioAPv8gMotrJlZTFwglagYqckJEX1fLvg2vCOIJVfZx23pLMKwu0kMosHU2TJEE42L3PHJCygQBsaqUei7q2GmAE1OvpdyyA2K6f4U-qDG0gFChJCyiiFe6KgYhekG7cdzFKfmztAXfzdnIapCZ5hWCdvq58rcVhDFHy9z0kDGo3H5gg Jun 08 02:10:58.438924 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jun 08 02:10:58.438924 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jun 08 02:10:58.438924 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jun 08 02:10:58.438924 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jun 08 02:10:58.438924 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jun 08 02:10:58.438924 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jun 08 02:10:58.438924 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Id: d40d753f66ec4ed2808aa65b825e66f8 Jun 08 02:10:58.438924 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-237519543 Jun 08 02:10:58.438924 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jun 08 02:10:58.438924 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jun 08 02:10:58.440372 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d40d753f66ec4ed2808aa65b825e66f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d40d753f66ec4ed2808aa65b825e66f8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d40d753f66ec4ed2808aa65b825e66f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d40d753f66ec4ed2808aa65b825e66f8"}]}] Jun 08 02:10:58.440372 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-ServerRescueNegativeTestJSON-237519543 Jun 08 02:10:58.440372 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Id: d40d753f66ec4ed2808aa65b825e66f8 Jun 08 02:10:58.440372 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-237519543 Jun 08 02:10:58.440372 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User: tempest-ServerRescueNegativeTestJSON-237519543-project Jun 08 02:10:58.440372 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jun 08 02:10:58.440372 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jun 08 02:10:58.440372 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Id: 9e13bd970d2e4d67b62452ae0d6cae56 Jun 08 02:10:58.440372 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-ServerRescueNegativeTestJSON-237519543-project Jun 08 02:10:58.440372 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: method: > Jun 08 02:10:58.440372 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: exception: Instance f4fe47a1-fdef-478e-94c7-42b5945a57ae could not be found. Jun 08 02:10:58.440372 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: action_args: {'id': 'f4fe47a1-fdef-478e-94c7-42b5945a57ae'} Jun 08 02:10:58.441337 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:10:58.441337 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:10:58.441337 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:10:58.441337 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:10:58.441337 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:10:58.441337 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:10:58.441337 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:10:58.441337 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:10:58.441337 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:10:58.441337 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:10:58.441337 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4fe47a1-fdef-478e-94c7-42b5945a57ae could not be found. Jun 08 02:10:58.441337 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:10:58.441337 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:10:58.441337 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:10:58.441337 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:10:58.441337 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:10:58.441337 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:10:58.441337 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:10:58.441337 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:10:58.441337 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:10:58.442921 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:10:58.442921 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 02:10:58.442921 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 02:10:58.442921 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:10:58.442921 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:10:58.442921 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:10:58.442921 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:10:58.442921 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4fe47a1-fdef-478e-94c7-42b5945a57ae could not be found. Jun 08 02:10:58.442921 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:10:58.442921 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:10:58.442921 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:10:58.442921 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:10:58.442921 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:10:58.442921 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:10:58.442921 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:10:58.442921 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:10:58.442921 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4fe47a1-fdef-478e-94c7-42b5945a57ae could not be found. Jun 08 02:10:58.442921 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:10:58.444372 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2bb55b5b-330f-42ce-98f0-bf7810de6e27 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] Returning 404 to user: Instance f4fe47a1-fdef-478e-94c7-42b5945a57ae could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:10:58.444372 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2bb55b5b-330f-42ce-98f0-bf7810de6e27 tempest-ServerRescueNegativeTestJSON-237519543 tempest-ServerRescueNegativeTestJSON-237519543-project] 10.222.0.20 "GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae" status: 404 len: 111 microversion: 2.1 time: 0.029252 Jun 08 02:10:58.444372 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 309/630] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:10:58 2022] GET /compute/v2.1/servers/f4fe47a1-fdef-478e-94c7-42b5945a57ae => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 02:11:01.395753 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c50234c9-6960-4143-b862-1967ce5fe62c tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:11:01.396383 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c50234c9-6960-4143-b862-1967ce5fe62c tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:01.403111 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c50234c9-6960-4143-b862-1967ce5fe62c tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:01.403767 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c50234c9-6960-4143-b862-1967ce5fe62c tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:01.404730 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c50234c9-6960-4143-b862-1967ce5fe62c tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:01.405336 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c50234c9-6960-4143-b862-1967ce5fe62c tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:01.436539 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.objects.instance [None req-c50234c9-6960-4143-b862-1967ce5fe62c tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lazy-loading 'flavor' on Instance uuid 4cf1e158-1c3a-488c-8227-d7279cea2978 {{(pid=117939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 02:11:01.549539 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c50234c9-6960-4143-b862-1967ce5fe62c tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "POST /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978/action" status: 202 len: 0 microversion: 2.1 time: 0.159409 Jun 08 02:11:01.553248 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 322/631] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jun 8 02:11:01 2022] POST /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 02:11:01.559457 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ae87564c-02c3-4e32-9125-7181c716f866 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:01.560791 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ae87564c-02c3-4e32-9125-7181c716f866 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:01.572202 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ae87564c-02c3-4e32-9125-7181c716f866 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:01.574939 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ae87564c-02c3-4e32-9125-7181c716f866 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:01.576011 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ae87564c-02c3-4e32-9125-7181c716f866 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:01.578223 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ae87564c-02c3-4e32-9125-7181c716f866 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:01.816586 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ae87564c-02c3-4e32-9125-7181c716f866 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:01.825441 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ae87564c-02c3-4e32-9125-7181c716f866 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1569 microversion: 2.1 time: 0.270121 Jun 08 02:11:01.826007 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 310/632] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:11:01 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1569 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:11:02.844027 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-73cadfbe-51ca-4e23-84a1-5a6dbd378a42 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:02.844831 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-73cadfbe-51ca-4e23-84a1-5a6dbd378a42 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:02.851790 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-73cadfbe-51ca-4e23-84a1-5a6dbd378a42 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:02.852313 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-73cadfbe-51ca-4e23-84a1-5a6dbd378a42 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:02.853194 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-73cadfbe-51ca-4e23-84a1-5a6dbd378a42 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:02.853706 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-73cadfbe-51ca-4e23-84a1-5a6dbd378a42 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:02.993760 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-73cadfbe-51ca-4e23-84a1-5a6dbd378a42 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:03.001140 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-73cadfbe-51ca-4e23-84a1-5a6dbd378a42 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1569 microversion: 2.1 time: 0.161852 Jun 08 02:11:03.001697 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 323/633] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:11:02 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:11:04.018018 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-aef6f38d-5740-41f7-8144-3db8472d500f tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:04.018681 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-aef6f38d-5740-41f7-8144-3db8472d500f tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:04.025561 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aef6f38d-5740-41f7-8144-3db8472d500f tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:04.026004 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aef6f38d-5740-41f7-8144-3db8472d500f tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:04.026757 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aef6f38d-5740-41f7-8144-3db8472d500f tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:04.027184 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aef6f38d-5740-41f7-8144-3db8472d500f tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:04.161056 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-aef6f38d-5740-41f7-8144-3db8472d500f tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:04.169371 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-aef6f38d-5740-41f7-8144-3db8472d500f tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1569 microversion: 2.1 time: 0.155587 Jun 08 02:11:04.169935 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 311/634] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:11:04 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:11:05.187581 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a169ed3d-b3b1-4574-9871-bd373d8afbfd tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:05.188336 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a169ed3d-b3b1-4574-9871-bd373d8afbfd tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:05.195486 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a169ed3d-b3b1-4574-9871-bd373d8afbfd tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:05.196017 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a169ed3d-b3b1-4574-9871-bd373d8afbfd tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:05.196905 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a169ed3d-b3b1-4574-9871-bd373d8afbfd tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:05.197442 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a169ed3d-b3b1-4574-9871-bd373d8afbfd tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:05.331331 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a169ed3d-b3b1-4574-9871-bd373d8afbfd tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:05.339161 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a169ed3d-b3b1-4574-9871-bd373d8afbfd tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1569 microversion: 2.1 time: 0.156486 Jun 08 02:11:05.339802 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 324/635] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:11:05 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:11:06.355582 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-84e9adad-c43d-4e73-987c-00a433d49efd tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:06.356373 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-84e9adad-c43d-4e73-987c-00a433d49efd tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:06.362646 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-84e9adad-c43d-4e73-987c-00a433d49efd tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:06.363093 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-84e9adad-c43d-4e73-987c-00a433d49efd tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:06.363854 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-84e9adad-c43d-4e73-987c-00a433d49efd tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:06.364287 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-84e9adad-c43d-4e73-987c-00a433d49efd tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:06.501809 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-84e9adad-c43d-4e73-987c-00a433d49efd tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:06.510098 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-84e9adad-c43d-4e73-987c-00a433d49efd tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1569 microversion: 2.1 time: 0.158356 Jun 08 02:11:06.510682 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 312/636] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:11:06 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:11:07.527976 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d1ef0872-e45b-4162-98d2-2710a0c3f556 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:07.528643 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d1ef0872-e45b-4162-98d2-2710a0c3f556 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:07.535116 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d1ef0872-e45b-4162-98d2-2710a0c3f556 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:07.535585 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d1ef0872-e45b-4162-98d2-2710a0c3f556 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:07.536408 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d1ef0872-e45b-4162-98d2-2710a0c3f556 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:07.536885 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d1ef0872-e45b-4162-98d2-2710a0c3f556 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:07.670558 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d1ef0872-e45b-4162-98d2-2710a0c3f556 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:07.678914 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d1ef0872-e45b-4162-98d2-2710a0c3f556 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1569 microversion: 2.1 time: 0.155143 Jun 08 02:11:07.679685 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 325/637] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:11:07 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:11:08.696619 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-94548271-ae8e-4850-87fd-36292a7838c5 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:08.697234 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-94548271-ae8e-4850-87fd-36292a7838c5 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:08.703888 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-94548271-ae8e-4850-87fd-36292a7838c5 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:08.704322 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-94548271-ae8e-4850-87fd-36292a7838c5 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:08.705109 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-94548271-ae8e-4850-87fd-36292a7838c5 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:08.705544 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-94548271-ae8e-4850-87fd-36292a7838c5 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:08.848888 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-94548271-ae8e-4850-87fd-36292a7838c5 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:08.857216 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-94548271-ae8e-4850-87fd-36292a7838c5 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1569 microversion: 2.1 time: 0.165122 Jun 08 02:11:08.857782 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 313/638] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:11:08 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:11:09.875729 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a939077c-3561-4020-bdcf-f1197d2daf02 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:09.876316 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a939077c-3561-4020-bdcf-f1197d2daf02 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:09.883328 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a939077c-3561-4020-bdcf-f1197d2daf02 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:09.883771 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a939077c-3561-4020-bdcf-f1197d2daf02 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:09.884560 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a939077c-3561-4020-bdcf-f1197d2daf02 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:09.884994 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a939077c-3561-4020-bdcf-f1197d2daf02 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:10.018778 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a939077c-3561-4020-bdcf-f1197d2daf02 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:10.026894 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a939077c-3561-4020-bdcf-f1197d2daf02 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1569 microversion: 2.1 time: 0.155074 Jun 08 02:11:10.027456 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 326/639] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:11:09 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:11:10.608263 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-de54e1f3-53f3-4228-8111-c82310928679 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:10.608817 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-de54e1f3-53f3-4228-8111-c82310928679 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:10.615031 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-de54e1f3-53f3-4228-8111-c82310928679 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:10.615469 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-de54e1f3-53f3-4228-8111-c82310928679 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:10.617167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-de54e1f3-53f3-4228-8111-c82310928679 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:10.617604 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-de54e1f3-53f3-4228-8111-c82310928679 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:10.639532 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-de54e1f3-53f3-4228-8111-c82310928679 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183/ips" status: 200 len: 152 microversion: 2.20 time: 0.035192 Jun 08 02:11:10.640076 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 314/640] 10.222.0.20 () {60 vars in 1288 bytes} [Wed Jun 8 02:11:10 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183/ips => generated 152 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 08 02:11:11.044466 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-6df06894-46e5-4dba-8ef7-bd86ec511bf4 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:11.045074 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-6df06894-46e5-4dba-8ef7-bd86ec511bf4 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:11.051874 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6df06894-46e5-4dba-8ef7-bd86ec511bf4 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:11.052324 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6df06894-46e5-4dba-8ef7-bd86ec511bf4 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:11.053127 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6df06894-46e5-4dba-8ef7-bd86ec511bf4 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:11.053665 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6df06894-46e5-4dba-8ef7-bd86ec511bf4 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:11.186662 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-6df06894-46e5-4dba-8ef7-bd86ec511bf4 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:11.194269 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-6df06894-46e5-4dba-8ef7-bd86ec511bf4 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1569 microversion: 2.1 time: 0.153427 Jun 08 02:11:11.194847 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 327/641] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:11:11 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:11:12.211453 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3cc47384-11a6-4a95-ae5c-b6e7687f97ab tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:12.212006 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3cc47384-11a6-4a95-ae5c-b6e7687f97ab tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:12.218656 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3cc47384-11a6-4a95-ae5c-b6e7687f97ab tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:12.219106 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3cc47384-11a6-4a95-ae5c-b6e7687f97ab tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:12.219866 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3cc47384-11a6-4a95-ae5c-b6e7687f97ab tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:12.220302 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3cc47384-11a6-4a95-ae5c-b6e7687f97ab tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:12.351385 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3cc47384-11a6-4a95-ae5c-b6e7687f97ab tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:12.358939 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3cc47384-11a6-4a95-ae5c-b6e7687f97ab tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1569 microversion: 2.1 time: 0.151681 Jun 08 02:11:12.359502 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 315/642] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:11:12 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:11:13.376987 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ec3a5ce3-152a-4313-affa-b171e0243083 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:13.377589 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ec3a5ce3-152a-4313-affa-b171e0243083 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:13.384695 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ec3a5ce3-152a-4313-affa-b171e0243083 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:13.385139 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ec3a5ce3-152a-4313-affa-b171e0243083 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:13.385894 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ec3a5ce3-152a-4313-affa-b171e0243083 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:13.386325 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ec3a5ce3-152a-4313-affa-b171e0243083 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:13.609165 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ec3a5ce3-152a-4313-affa-b171e0243083 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:13.618446 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ec3a5ce3-152a-4313-affa-b171e0243083 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1569 microversion: 2.1 time: 0.245290 Jun 08 02:11:13.619090 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 328/643] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:11:13 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1569 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:11:14.636335 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d65ace17-7cfb-47f3-8f5c-b9efec67314f tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:14.636962 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d65ace17-7cfb-47f3-8f5c-b9efec67314f tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:14.643351 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d65ace17-7cfb-47f3-8f5c-b9efec67314f tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:14.643788 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d65ace17-7cfb-47f3-8f5c-b9efec67314f tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:14.644588 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d65ace17-7cfb-47f3-8f5c-b9efec67314f tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:14.645017 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d65ace17-7cfb-47f3-8f5c-b9efec67314f tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:14.775248 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d65ace17-7cfb-47f3-8f5c-b9efec67314f tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:14.782868 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d65ace17-7cfb-47f3-8f5c-b9efec67314f tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1569 microversion: 2.1 time: 0.151172 Jun 08 02:11:14.783429 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 316/644] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:11:14 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:11:15.073347 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-1764f6fa-9efa-43e3-b313-bedaae176a48 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:11:15.073889 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-1764f6fa-9efa-43e3-b313-bedaae176a48 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:15.080201 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1764f6fa-9efa-43e3-b313-bedaae176a48 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:15.080673 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1764f6fa-9efa-43e3-b313-bedaae176a48 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:15.081419 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1764f6fa-9efa-43e3-b313-bedaae176a48 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:15.081846 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1764f6fa-9efa-43e3-b313-bedaae176a48 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:15.105020 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.objects.instance [None req-1764f6fa-9efa-43e3-b313-bedaae176a48 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lazy-loading 'flavor' on Instance uuid 19726b62-06f4-4547-9021-b58c9571f183 {{(pid=117939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 02:11:15.366138 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-1764f6fa-9efa-43e3-b313-bedaae176a48 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "POST /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183/action" status: 202 len: 0 microversion: 2.20 time: 0.297345 Jun 08 02:11:15.367504 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 329/645] 10.222.0.20 () {62 vars in 1318 bytes} [Wed Jun 8 02:11:15 2022] POST /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 08 02:11:15.375625 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3ee43503-b73e-40c0-833c-f80a6a0a3cff tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:15.376235 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3ee43503-b73e-40c0-833c-f80a6a0a3cff tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:15.382888 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3ee43503-b73e-40c0-833c-f80a6a0a3cff tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:15.383349 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3ee43503-b73e-40c0-833c-f80a6a0a3cff tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:15.384118 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3ee43503-b73e-40c0-833c-f80a6a0a3cff tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:15.384587 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3ee43503-b73e-40c0-833c-f80a6a0a3cff tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:15.524033 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3ee43503-b73e-40c0-833c-f80a6a0a3cff tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:15.532209 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3ee43503-b73e-40c0-833c-f80a6a0a3cff tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:15.533760 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3ee43503-b73e-40c0-833c-f80a6a0a3cff tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:15.534918 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3ee43503-b73e-40c0-833c-f80a6a0a3cff tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1724 microversion: 2.20 time: 0.163289 Jun 08 02:11:15.535476 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 317/646] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:11:15 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:11:15.799408 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-aa4f0022-f1c7-4f2d-92b3-5e705afc8b38 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:15.800157 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-aa4f0022-f1c7-4f2d-92b3-5e705afc8b38 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:15.806502 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-aa4f0022-f1c7-4f2d-92b3-5e705afc8b38 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:15.806950 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-aa4f0022-f1c7-4f2d-92b3-5e705afc8b38 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:15.807707 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-aa4f0022-f1c7-4f2d-92b3-5e705afc8b38 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:15.808147 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-aa4f0022-f1c7-4f2d-92b3-5e705afc8b38 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:15.940933 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-aa4f0022-f1c7-4f2d-92b3-5e705afc8b38 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:15.950844 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-aa4f0022-f1c7-4f2d-92b3-5e705afc8b38 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1569 microversion: 2.1 time: 0.155327 Jun 08 02:11:15.951415 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 330/647] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:11:15 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:11:16.554806 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b448cf92-11bc-4817-bfe2-55051a405507 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:16.555400 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b448cf92-11bc-4817-bfe2-55051a405507 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:16.561924 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b448cf92-11bc-4817-bfe2-55051a405507 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:16.562368 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b448cf92-11bc-4817-bfe2-55051a405507 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:16.563123 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b448cf92-11bc-4817-bfe2-55051a405507 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:16.563553 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b448cf92-11bc-4817-bfe2-55051a405507 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:16.715244 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b448cf92-11bc-4817-bfe2-55051a405507 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:16.723233 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b448cf92-11bc-4817-bfe2-55051a405507 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:16.724814 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b448cf92-11bc-4817-bfe2-55051a405507 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:16.726427 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b448cf92-11bc-4817-bfe2-55051a405507 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1724 microversion: 2.20 time: 0.175570 Jun 08 02:11:16.727142 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 318/648] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:11:16 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:11:16.982427 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a5cdb122-9a41-4a50-b970-4aa4ed7bc01d tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:16.983072 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a5cdb122-9a41-4a50-b970-4aa4ed7bc01d tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:16.997048 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a5cdb122-9a41-4a50-b970-4aa4ed7bc01d tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:16.997504 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a5cdb122-9a41-4a50-b970-4aa4ed7bc01d tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:16.998285 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a5cdb122-9a41-4a50-b970-4aa4ed7bc01d tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:16.998724 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a5cdb122-9a41-4a50-b970-4aa4ed7bc01d tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:17.139595 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a5cdb122-9a41-4a50-b970-4aa4ed7bc01d tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:17.147072 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a5cdb122-9a41-4a50-b970-4aa4ed7bc01d tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1510 microversion: 2.1 time: 0.180465 Jun 08 02:11:17.148140 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 331/649] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:11:16 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1510 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:11:17.165476 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7ecb4e03-dcc9-4a14-b936-b456c8d6c123 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:11:17.166053 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7ecb4e03-dcc9-4a14-b936-b456c8d6c123 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:17.172107 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7ecb4e03-dcc9-4a14-b936-b456c8d6c123 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:17.172605 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7ecb4e03-dcc9-4a14-b936-b456c8d6c123 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:17.173371 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7ecb4e03-dcc9-4a14-b936-b456c8d6c123 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:17.173808 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7ecb4e03-dcc9-4a14-b936-b456c8d6c123 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:17.176302 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:11:17.276083 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7ecb4e03-dcc9-4a14-b936-b456c8d6c123 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "POST /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978/action" status: 202 len: 0 microversion: 2.1 time: 0.115328 Jun 08 02:11:17.276970 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 319/650] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jun 8 02:11:17 2022] POST /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 02:11:17.285180 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b806bb1f-96d8-4661-9cfc-d5224a8e9625 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:17.286877 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-b806bb1f-96d8-4661-9cfc-d5224a8e9625 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:17.294487 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b806bb1f-96d8-4661-9cfc-d5224a8e9625 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:17.294951 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b806bb1f-96d8-4661-9cfc-d5224a8e9625 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:17.295726 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b806bb1f-96d8-4661-9cfc-d5224a8e9625 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:17.296163 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b806bb1f-96d8-4661-9cfc-d5224a8e9625 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:17.457228 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b806bb1f-96d8-4661-9cfc-d5224a8e9625 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:17.470076 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-b806bb1f-96d8-4661-9cfc-d5224a8e9625 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1518 microversion: 2.1 time: 0.188821 Jun 08 02:11:17.472460 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 332/651] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:11:17 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1518 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:11:17.746353 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3305cb95-38b3-43ff-a218-39b9b0deb9c7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:17.747021 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3305cb95-38b3-43ff-a218-39b9b0deb9c7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:17.753749 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3305cb95-38b3-43ff-a218-39b9b0deb9c7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:17.754317 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3305cb95-38b3-43ff-a218-39b9b0deb9c7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:17.755154 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3305cb95-38b3-43ff-a218-39b9b0deb9c7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:17.755662 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3305cb95-38b3-43ff-a218-39b9b0deb9c7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:17.909896 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3305cb95-38b3-43ff-a218-39b9b0deb9c7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:17.919102 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3305cb95-38b3-43ff-a218-39b9b0deb9c7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:17.921190 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3305cb95-38b3-43ff-a218-39b9b0deb9c7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:17.922582 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3305cb95-38b3-43ff-a218-39b9b0deb9c7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1724 microversion: 2.20 time: 0.181482 Jun 08 02:11:17.933702 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 320/652] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:11:17 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 02:11:18.489187 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-7deff985-e464-4ba8-a564-058a08a223a9 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:18.489806 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-7deff985-e464-4ba8-a564-058a08a223a9 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:18.497220 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7deff985-e464-4ba8-a564-058a08a223a9 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:18.497670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7deff985-e464-4ba8-a564-058a08a223a9 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:18.498446 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7deff985-e464-4ba8-a564-058a08a223a9 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:18.498886 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7deff985-e464-4ba8-a564-058a08a223a9 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:18.513895 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:11:18.636367 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7deff985-e464-4ba8-a564-058a08a223a9 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:18.643655 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-7deff985-e464-4ba8-a564-058a08a223a9 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1576 microversion: 2.1 time: 0.159161 Jun 08 02:11:18.644194 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 333/653] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:11:18 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:11:18.941501 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-15a075af-e31a-421e-abbe-7b898c4e781b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:18.942216 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-15a075af-e31a-421e-abbe-7b898c4e781b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:18.949016 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-15a075af-e31a-421e-abbe-7b898c4e781b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:18.949689 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-15a075af-e31a-421e-abbe-7b898c4e781b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:18.950698 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-15a075af-e31a-421e-abbe-7b898c4e781b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:18.951213 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-15a075af-e31a-421e-abbe-7b898c4e781b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:19.166743 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-15a075af-e31a-421e-abbe-7b898c4e781b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:19.175179 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-15a075af-e31a-421e-abbe-7b898c4e781b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:19.176731 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-15a075af-e31a-421e-abbe-7b898c4e781b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:19.178064 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-15a075af-e31a-421e-abbe-7b898c4e781b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1724 microversion: 2.20 time: 0.240998 Jun 08 02:11:19.179229 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 321/654] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:11:18 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:11:19.486407 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-eb9dcd0e-0b23-4a1f-8b26-fe8410da3855 req-ea8678ad-c94a-48e5-94ab-42eaa8afa062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cf1e158-1c3a-488c-8227-d7279cea2978", "name": "network-vif-unplugged", "status": "completed", "tag": "8bbb59fb-caf5-486d-bd77-92280696e47b"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:11:19.495025 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-eb9dcd0e-0b23-4a1f-8b26-fe8410da3855 req-ea8678ad-c94a-48e5-94ab-42eaa8afa062 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:19.495673 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-eb9dcd0e-0b23-4a1f-8b26-fe8410da3855 req-ea8678ad-c94a-48e5-94ab-42eaa8afa062 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:19.506496 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-eb9dcd0e-0b23-4a1f-8b26-fe8410da3855 req-ea8678ad-c94a-48e5-94ab-42eaa8afa062 service nova] Creating event network-vif-unplugged:8bbb59fb-caf5-486d-bd77-92280696e47b for instance 4cf1e158-1c3a-488c-8227-d7279cea2978 on hv-cinder-84506 Jun 08 02:11:19.511923 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-eb9dcd0e-0b23-4a1f-8b26-fe8410da3855 req-ea8678ad-c94a-48e5-94ab-42eaa8afa062 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.173432 Jun 08 02:11:19.512536 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 334/655] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:11:19.661179 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c60094f9-a14c-4127-be00-28b4bd4213fd tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:19.661787 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c60094f9-a14c-4127-be00-28b4bd4213fd tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:19.667895 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c60094f9-a14c-4127-be00-28b4bd4213fd tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:19.668340 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c60094f9-a14c-4127-be00-28b4bd4213fd tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:19.669126 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c60094f9-a14c-4127-be00-28b4bd4213fd tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:19.669638 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c60094f9-a14c-4127-be00-28b4bd4213fd tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:19.799682 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c60094f9-a14c-4127-be00-28b4bd4213fd tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:19.807717 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c60094f9-a14c-4127-be00-28b4bd4213fd tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1576 microversion: 2.1 time: 0.150379 Jun 08 02:11:19.808328 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 322/656] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:11:19 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:11:20.197581 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b242d7bd-f569-4f15-9ab9-eb729c7a6724 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:20.198203 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-b242d7bd-f569-4f15-9ab9-eb729c7a6724 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:20.204490 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b242d7bd-f569-4f15-9ab9-eb729c7a6724 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:20.204936 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b242d7bd-f569-4f15-9ab9-eb729c7a6724 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:20.205729 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b242d7bd-f569-4f15-9ab9-eb729c7a6724 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:20.206296 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b242d7bd-f569-4f15-9ab9-eb729c7a6724 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:20.338010 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b242d7bd-f569-4f15-9ab9-eb729c7a6724 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:20.345893 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b242d7bd-f569-4f15-9ab9-eb729c7a6724 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:20.347410 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b242d7bd-f569-4f15-9ab9-eb729c7a6724 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:20.348594 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-b242d7bd-f569-4f15-9ab9-eb729c7a6724 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1724 microversion: 2.20 time: 0.156192 Jun 08 02:11:20.349146 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 335/657] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:11:20 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 02:11:20.823934 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c5d734e5-a692-4fde-9178-ea561acf9186 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:20.824492 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c5d734e5-a692-4fde-9178-ea561acf9186 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:20.830934 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c5d734e5-a692-4fde-9178-ea561acf9186 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:20.831379 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c5d734e5-a692-4fde-9178-ea561acf9186 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:20.832138 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c5d734e5-a692-4fde-9178-ea561acf9186 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:20.832617 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c5d734e5-a692-4fde-9178-ea561acf9186 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:20.972019 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c5d734e5-a692-4fde-9178-ea561acf9186 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:20.980374 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c5d734e5-a692-4fde-9178-ea561acf9186 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1576 microversion: 2.1 time: 0.160460 Jun 08 02:11:20.980955 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 323/658] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:11:20 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:11:21.367271 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-6c6d5915-9f6b-4024-b75c-7b772e6bd219 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:21.367864 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-6c6d5915-9f6b-4024-b75c-7b772e6bd219 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:21.374334 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6c6d5915-9f6b-4024-b75c-7b772e6bd219 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:21.374775 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6c6d5915-9f6b-4024-b75c-7b772e6bd219 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:21.375519 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6c6d5915-9f6b-4024-b75c-7b772e6bd219 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:21.375944 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6c6d5915-9f6b-4024-b75c-7b772e6bd219 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:21.502250 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-6c6d5915-9f6b-4024-b75c-7b772e6bd219 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:21.510697 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-6c6d5915-9f6b-4024-b75c-7b772e6bd219 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:21.512188 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-6c6d5915-9f6b-4024-b75c-7b772e6bd219 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:21.513383 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-6c6d5915-9f6b-4024-b75c-7b772e6bd219 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1724 microversion: 2.20 time: 0.150556 Jun 08 02:11:21.513933 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 336/659] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:11:21 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:11:21.997214 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-62b74e4f-0649-4644-b6b4-f755424db4c2 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:21.997797 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-62b74e4f-0649-4644-b6b4-f755424db4c2 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:22.004204 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-62b74e4f-0649-4644-b6b4-f755424db4c2 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:22.004670 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-62b74e4f-0649-4644-b6b4-f755424db4c2 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:22.005418 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-62b74e4f-0649-4644-b6b4-f755424db4c2 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:22.005844 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-62b74e4f-0649-4644-b6b4-f755424db4c2 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:22.136166 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-62b74e4f-0649-4644-b6b4-f755424db4c2 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:22.143576 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-62b74e4f-0649-4644-b6b4-f755424db4c2 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1576 microversion: 2.1 time: 0.150177 Jun 08 02:11:22.144138 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 324/660] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:11:21 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:11:22.531483 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0f3ae130-5cef-4c94-a028-aff148bb2dd6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:22.532111 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-0f3ae130-5cef-4c94-a028-aff148bb2dd6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:22.538850 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0f3ae130-5cef-4c94-a028-aff148bb2dd6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:22.539291 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0f3ae130-5cef-4c94-a028-aff148bb2dd6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:22.540039 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0f3ae130-5cef-4c94-a028-aff148bb2dd6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:22.540513 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0f3ae130-5cef-4c94-a028-aff148bb2dd6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:22.669737 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-0f3ae130-5cef-4c94-a028-aff148bb2dd6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:22.677615 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-0f3ae130-5cef-4c94-a028-aff148bb2dd6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:22.679885 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-0f3ae130-5cef-4c94-a028-aff148bb2dd6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:22.681060 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-0f3ae130-5cef-4c94-a028-aff148bb2dd6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1724 microversion: 2.20 time: 0.153818 Jun 08 02:11:22.681616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 337/661] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:11:22 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:11:23.161370 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-894747cc-b1ce-41cf-add8-0df69999b43b tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:23.161940 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-894747cc-b1ce-41cf-add8-0df69999b43b tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:23.168966 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-894747cc-b1ce-41cf-add8-0df69999b43b tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:23.169411 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-894747cc-b1ce-41cf-add8-0df69999b43b tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:23.170161 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-894747cc-b1ce-41cf-add8-0df69999b43b tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:23.170594 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-894747cc-b1ce-41cf-add8-0df69999b43b tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:23.302163 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-894747cc-b1ce-41cf-add8-0df69999b43b tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:23.309923 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-894747cc-b1ce-41cf-add8-0df69999b43b tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1576 microversion: 2.1 time: 0.152406 Jun 08 02:11:23.310497 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 325/662] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:11:23 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:11:23.699809 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-16fee641-88be-46a9-8b03-c7b67f84ca31 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:23.700440 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-16fee641-88be-46a9-8b03-c7b67f84ca31 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:23.702950 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=40 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:11:23.708310 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-16fee641-88be-46a9-8b03-c7b67f84ca31 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:23.708792 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-16fee641-88be-46a9-8b03-c7b67f84ca31 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:23.709559 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-16fee641-88be-46a9-8b03-c7b67f84ca31 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:23.710001 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-16fee641-88be-46a9-8b03-c7b67f84ca31 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:23.838623 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-16fee641-88be-46a9-8b03-c7b67f84ca31 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:23.847422 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-16fee641-88be-46a9-8b03-c7b67f84ca31 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:23.848976 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-16fee641-88be-46a9-8b03-c7b67f84ca31 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:23.850142 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-16fee641-88be-46a9-8b03-c7b67f84ca31 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1724 microversion: 2.20 time: 0.154311 Jun 08 02:11:23.850701 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 338/663] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:11:23 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 02:11:24.327709 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5ee452cd-3dbc-46a8-bfc9-e73f32d11baf tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:24.328365 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5ee452cd-3dbc-46a8-bfc9-e73f32d11baf tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:24.330639 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:11:24.336951 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5ee452cd-3dbc-46a8-bfc9-e73f32d11baf tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:24.337394 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5ee452cd-3dbc-46a8-bfc9-e73f32d11baf tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:24.338152 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5ee452cd-3dbc-46a8-bfc9-e73f32d11baf tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:24.338586 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5ee452cd-3dbc-46a8-bfc9-e73f32d11baf tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:24.468107 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5ee452cd-3dbc-46a8-bfc9-e73f32d11baf tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:24.475680 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5ee452cd-3dbc-46a8-bfc9-e73f32d11baf tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1576 microversion: 2.1 time: 0.151654 Jun 08 02:11:24.476250 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 326/664] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:11:24 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:11:24.870240 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-37c16401-9efd-4e52-8347-585e77370c37 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:24.870845 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-37c16401-9efd-4e52-8347-585e77370c37 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:24.877206 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-37c16401-9efd-4e52-8347-585e77370c37 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:24.877645 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-37c16401-9efd-4e52-8347-585e77370c37 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:24.878399 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-37c16401-9efd-4e52-8347-585e77370c37 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:24.878828 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-37c16401-9efd-4e52-8347-585e77370c37 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:25.008103 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-37c16401-9efd-4e52-8347-585e77370c37 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:25.016051 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-37c16401-9efd-4e52-8347-585e77370c37 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:25.017723 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-37c16401-9efd-4e52-8347-585e77370c37 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:25.018954 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-37c16401-9efd-4e52-8347-585e77370c37 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1724 microversion: 2.20 time: 0.154021 Jun 08 02:11:25.019608 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 339/665] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:11:24 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:11:25.493071 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-78f80dd1-e399-410a-883e-8df638979ef9 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:25.493660 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-78f80dd1-e399-410a-883e-8df638979ef9 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:25.500060 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-78f80dd1-e399-410a-883e-8df638979ef9 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:25.500532 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-78f80dd1-e399-410a-883e-8df638979ef9 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:25.501287 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-78f80dd1-e399-410a-883e-8df638979ef9 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:25.501719 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-78f80dd1-e399-410a-883e-8df638979ef9 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:25.630826 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-78f80dd1-e399-410a-883e-8df638979ef9 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:25.638250 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-78f80dd1-e399-410a-883e-8df638979ef9 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1576 microversion: 2.1 time: 0.149792 Jun 08 02:11:25.638807 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 327/666] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:11:25 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:11:26.036767 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ddce4413-ad6c-482b-b178-509aa0941023 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:26.037363 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ddce4413-ad6c-482b-b178-509aa0941023 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:26.045004 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ddce4413-ad6c-482b-b178-509aa0941023 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:26.045462 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ddce4413-ad6c-482b-b178-509aa0941023 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:26.046223 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ddce4413-ad6c-482b-b178-509aa0941023 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:26.046659 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ddce4413-ad6c-482b-b178-509aa0941023 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:26.187398 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ddce4413-ad6c-482b-b178-509aa0941023 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:26.195418 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ddce4413-ad6c-482b-b178-509aa0941023 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:26.196958 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ddce4413-ad6c-482b-b178-509aa0941023 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:26.198090 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ddce4413-ad6c-482b-b178-509aa0941023 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1724 microversion: 2.20 time: 0.165188 Jun 08 02:11:26.198649 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 340/667] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:11:26 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:11:26.655146 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-75a6162f-06d5-424a-b29e-154bf3b47977 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:26.655756 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-75a6162f-06d5-424a-b29e-154bf3b47977 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:26.662563 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-75a6162f-06d5-424a-b29e-154bf3b47977 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:26.663009 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-75a6162f-06d5-424a-b29e-154bf3b47977 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:26.663767 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-75a6162f-06d5-424a-b29e-154bf3b47977 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:26.664201 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-75a6162f-06d5-424a-b29e-154bf3b47977 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:26.800154 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-75a6162f-06d5-424a-b29e-154bf3b47977 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:26.808470 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-75a6162f-06d5-424a-b29e-154bf3b47977 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1576 microversion: 2.1 time: 0.157058 Jun 08 02:11:26.809077 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 328/668] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:11:26 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:11:27.216072 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b35224a3-064a-4a37-b01c-316c788cb82a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:27.217373 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-b35224a3-064a-4a37-b01c-316c788cb82a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:27.223909 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b35224a3-064a-4a37-b01c-316c788cb82a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:27.224346 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b35224a3-064a-4a37-b01c-316c788cb82a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:27.225129 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b35224a3-064a-4a37-b01c-316c788cb82a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:27.226305 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b35224a3-064a-4a37-b01c-316c788cb82a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:27.358761 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b35224a3-064a-4a37-b01c-316c788cb82a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:27.367492 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b35224a3-064a-4a37-b01c-316c788cb82a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:27.369060 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b35224a3-064a-4a37-b01c-316c788cb82a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:27.370199 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-b35224a3-064a-4a37-b01c-316c788cb82a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1724 microversion: 2.20 time: 0.158388 Jun 08 02:11:27.370755 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 341/669] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:11:27 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:11:27.825796 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cf7a31b5-a028-4f2b-b749-63519972a4ee tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:27.826327 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-cf7a31b5-a028-4f2b-b749-63519972a4ee tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:27.833015 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cf7a31b5-a028-4f2b-b749-63519972a4ee tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:27.833466 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cf7a31b5-a028-4f2b-b749-63519972a4ee tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:27.834421 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cf7a31b5-a028-4f2b-b749-63519972a4ee tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:27.834877 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cf7a31b5-a028-4f2b-b749-63519972a4ee tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:28.124016 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-cf7a31b5-a028-4f2b-b749-63519972a4ee tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:28.131739 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-cf7a31b5-a028-4f2b-b749-63519972a4ee tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1576 microversion: 2.1 time: 0.309854 Jun 08 02:11:28.132650 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 329/670] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:11:27 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1576 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:11:28.388858 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e08d6e02-7eeb-47d9-960d-1c51521c0d10 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:28.389372 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e08d6e02-7eeb-47d9-960d-1c51521c0d10 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:28.395867 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e08d6e02-7eeb-47d9-960d-1c51521c0d10 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:28.396325 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e08d6e02-7eeb-47d9-960d-1c51521c0d10 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:28.397087 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e08d6e02-7eeb-47d9-960d-1c51521c0d10 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:28.398114 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e08d6e02-7eeb-47d9-960d-1c51521c0d10 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:28.608916 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e08d6e02-7eeb-47d9-960d-1c51521c0d10 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:28.617132 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e08d6e02-7eeb-47d9-960d-1c51521c0d10 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:28.618653 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e08d6e02-7eeb-47d9-960d-1c51521c0d10 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:28.619793 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e08d6e02-7eeb-47d9-960d-1c51521c0d10 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1724 microversion: 2.20 time: 0.235050 Jun 08 02:11:28.620564 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 342/671] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:11:28 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:11:29.148939 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-aa01aba7-ea82-4725-bb8f-2c3be0655b0e tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:29.149550 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-aa01aba7-ea82-4725-bb8f-2c3be0655b0e tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:29.156088 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aa01aba7-ea82-4725-bb8f-2c3be0655b0e tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:29.156840 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aa01aba7-ea82-4725-bb8f-2c3be0655b0e tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:29.157595 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aa01aba7-ea82-4725-bb8f-2c3be0655b0e tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:29.158039 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aa01aba7-ea82-4725-bb8f-2c3be0655b0e tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:29.293508 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-aa01aba7-ea82-4725-bb8f-2c3be0655b0e tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:29.300863 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-aa01aba7-ea82-4725-bb8f-2c3be0655b0e tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1576 microversion: 2.1 time: 0.155903 Jun 08 02:11:29.301426 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 330/672] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:11:29 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:11:29.637153 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c8a9d8a6-16db-4881-b8bd-220e757fc01f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:29.637760 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c8a9d8a6-16db-4881-b8bd-220e757fc01f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:29.644167 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c8a9d8a6-16db-4881-b8bd-220e757fc01f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:29.644664 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c8a9d8a6-16db-4881-b8bd-220e757fc01f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:29.645429 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c8a9d8a6-16db-4881-b8bd-220e757fc01f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:29.645864 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c8a9d8a6-16db-4881-b8bd-220e757fc01f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:29.779980 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c8a9d8a6-16db-4881-b8bd-220e757fc01f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:29.788779 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c8a9d8a6-16db-4881-b8bd-220e757fc01f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:29.790302 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c8a9d8a6-16db-4881-b8bd-220e757fc01f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:29.791522 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c8a9d8a6-16db-4881-b8bd-220e757fc01f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1724 microversion: 2.20 time: 0.158190 Jun 08 02:11:29.792089 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 343/673] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:11:29 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:11:30.317287 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b30e31d1-ebf4-4008-a695-b2c831bf8fa2 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:30.317889 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b30e31d1-ebf4-4008-a695-b2c831bf8fa2 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:30.324943 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b30e31d1-ebf4-4008-a695-b2c831bf8fa2 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:30.325385 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b30e31d1-ebf4-4008-a695-b2c831bf8fa2 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:30.326128 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b30e31d1-ebf4-4008-a695-b2c831bf8fa2 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:30.326554 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b30e31d1-ebf4-4008-a695-b2c831bf8fa2 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:30.454506 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b30e31d1-ebf4-4008-a695-b2c831bf8fa2 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:30.461975 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b30e31d1-ebf4-4008-a695-b2c831bf8fa2 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1576 microversion: 2.1 time: 0.148491 Jun 08 02:11:30.462550 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 331/674] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:11:30 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:11:30.810732 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-cd798dab-2971-41f4-ac39-f56e44d9baa6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:30.811334 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-cd798dab-2971-41f4-ac39-f56e44d9baa6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:30.817747 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cd798dab-2971-41f4-ac39-f56e44d9baa6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:30.818193 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cd798dab-2971-41f4-ac39-f56e44d9baa6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:30.818943 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cd798dab-2971-41f4-ac39-f56e44d9baa6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:30.819382 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cd798dab-2971-41f4-ac39-f56e44d9baa6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:30.944025 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-cd798dab-2971-41f4-ac39-f56e44d9baa6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:30.951812 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-cd798dab-2971-41f4-ac39-f56e44d9baa6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:30.953413 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-cd798dab-2971-41f4-ac39-f56e44d9baa6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:30.954566 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-cd798dab-2971-41f4-ac39-f56e44d9baa6 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1724 microversion: 2.20 time: 0.147812 Jun 08 02:11:30.955126 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 344/675] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:11:30 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:11:31.479926 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-62d11ca7-943f-4dfe-a0b5-4d98d3cfe49a tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:31.480541 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-62d11ca7-943f-4dfe-a0b5-4d98d3cfe49a tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:31.487482 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-62d11ca7-943f-4dfe-a0b5-4d98d3cfe49a tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:31.487922 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-62d11ca7-943f-4dfe-a0b5-4d98d3cfe49a tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:31.489331 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-62d11ca7-943f-4dfe-a0b5-4d98d3cfe49a tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:31.489771 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-62d11ca7-943f-4dfe-a0b5-4d98d3cfe49a tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:31.624836 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-62d11ca7-943f-4dfe-a0b5-4d98d3cfe49a tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:31.633086 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-62d11ca7-943f-4dfe-a0b5-4d98d3cfe49a tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1576 microversion: 2.1 time: 0.158202 Jun 08 02:11:31.633771 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 332/676] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:11:31 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:11:31.972844 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-5b0e0395-42dc-4643-bcab-1d1ecbcf94bd tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:31.973482 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-5b0e0395-42dc-4643-bcab-1d1ecbcf94bd tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:31.980620 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5b0e0395-42dc-4643-bcab-1d1ecbcf94bd tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:31.981070 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5b0e0395-42dc-4643-bcab-1d1ecbcf94bd tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:31.981829 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5b0e0395-42dc-4643-bcab-1d1ecbcf94bd tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:31.982266 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5b0e0395-42dc-4643-bcab-1d1ecbcf94bd tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:32.109211 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-5b0e0395-42dc-4643-bcab-1d1ecbcf94bd tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:32.117138 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-5b0e0395-42dc-4643-bcab-1d1ecbcf94bd tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:32.118651 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-5b0e0395-42dc-4643-bcab-1d1ecbcf94bd tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:32.119791 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-5b0e0395-42dc-4643-bcab-1d1ecbcf94bd tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1724 microversion: 2.20 time: 0.150871 Jun 08 02:11:32.120352 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 345/677] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:11:31 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 02:11:32.651426 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4ff6bafe-c88e-424a-8f53-90f891f40dc5 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:32.652143 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4ff6bafe-c88e-424a-8f53-90f891f40dc5 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:32.659783 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4ff6bafe-c88e-424a-8f53-90f891f40dc5 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:32.660570 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4ff6bafe-c88e-424a-8f53-90f891f40dc5 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:32.661591 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4ff6bafe-c88e-424a-8f53-90f891f40dc5 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:32.662225 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4ff6bafe-c88e-424a-8f53-90f891f40dc5 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:32.805535 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4ff6bafe-c88e-424a-8f53-90f891f40dc5 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:32.813828 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4ff6bafe-c88e-424a-8f53-90f891f40dc5 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1563 microversion: 2.1 time: 0.166950 Jun 08 02:11:32.814469 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 333/678] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:11:32 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1563 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:11:33.138531 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-3aeafc53-5882-4e35-ab83-0325a7e277d3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:33.139229 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-3aeafc53-5882-4e35-ab83-0325a7e277d3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:33.145692 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3aeafc53-5882-4e35-ab83-0325a7e277d3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:33.146150 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3aeafc53-5882-4e35-ab83-0325a7e277d3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:33.146905 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3aeafc53-5882-4e35-ab83-0325a7e277d3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:33.147406 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3aeafc53-5882-4e35-ab83-0325a7e277d3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:33.275297 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-3aeafc53-5882-4e35-ab83-0325a7e277d3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:33.283300 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-3aeafc53-5882-4e35-ab83-0325a7e277d3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:33.284840 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-3aeafc53-5882-4e35-ab83-0325a7e277d3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:33.285983 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-3aeafc53-5882-4e35-ab83-0325a7e277d3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1745 microversion: 2.20 time: 0.151967 Jun 08 02:11:33.286538 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 346/679] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:11:33 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:11:33.471114 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-8f5abd27-ee5e-496e-a677-1b16327ec734 req-4427040e-0433-4f37-88d9-d98b64d2e5ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cf1e158-1c3a-488c-8227-d7279cea2978", "name": "network-vif-plugged", "status": "completed", "tag": "8bbb59fb-caf5-486d-bd77-92280696e47b"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:11:33.480065 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-8f5abd27-ee5e-496e-a677-1b16327ec734 req-4427040e-0433-4f37-88d9-d98b64d2e5ef service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:33.480542 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-8f5abd27-ee5e-496e-a677-1b16327ec734 req-4427040e-0433-4f37-88d9-d98b64d2e5ef service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:33.492201 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-8f5abd27-ee5e-496e-a677-1b16327ec734 req-4427040e-0433-4f37-88d9-d98b64d2e5ef service nova] Creating event network-vif-plugged:8bbb59fb-caf5-486d-bd77-92280696e47b for instance 4cf1e158-1c3a-488c-8227-d7279cea2978 on hv-cinder-84506 Jun 08 02:11:33.497166 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-8f5abd27-ee5e-496e-a677-1b16327ec734 req-4427040e-0433-4f37-88d9-d98b64d2e5ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029710 Jun 08 02:11:33.497925 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 334/680] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:11:34.305272 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d0b48ab6-87dd-4643-b0a7-366c5ff06a36 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:34.305879 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d0b48ab6-87dd-4643-b0a7-366c5ff06a36 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:34.312356 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d0b48ab6-87dd-4643-b0a7-366c5ff06a36 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:34.312845 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d0b48ab6-87dd-4643-b0a7-366c5ff06a36 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:34.313599 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d0b48ab6-87dd-4643-b0a7-366c5ff06a36 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:34.314034 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d0b48ab6-87dd-4643-b0a7-366c5ff06a36 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:34.448986 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d0b48ab6-87dd-4643-b0a7-366c5ff06a36 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:34.457006 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d0b48ab6-87dd-4643-b0a7-366c5ff06a36 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:34.458519 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d0b48ab6-87dd-4643-b0a7-366c5ff06a36 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:34.459726 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d0b48ab6-87dd-4643-b0a7-366c5ff06a36 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1745 microversion: 2.20 time: 0.158327 Jun 08 02:11:34.460875 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 347/681] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:11:34 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:11:35.481279 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7ede2c7d-f162-404c-a7eb-b7756bfe44af tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:35.482604 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7ede2c7d-f162-404c-a7eb-b7756bfe44af tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:35.493398 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7ede2c7d-f162-404c-a7eb-b7756bfe44af tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:35.494194 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7ede2c7d-f162-404c-a7eb-b7756bfe44af tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:35.495178 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7ede2c7d-f162-404c-a7eb-b7756bfe44af tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:35.495840 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7ede2c7d-f162-404c-a7eb-b7756bfe44af tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:35.521714 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:11:35.681258 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7ede2c7d-f162-404c-a7eb-b7756bfe44af tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:35.692363 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7ede2c7d-f162-404c-a7eb-b7756bfe44af tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:35.694440 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7ede2c7d-f162-404c-a7eb-b7756bfe44af tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:35.695643 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7ede2c7d-f162-404c-a7eb-b7756bfe44af tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1740 microversion: 2.20 time: 0.219439 Jun 08 02:11:35.707102 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 335/682] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:11:35 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1740 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:11:36.715033 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c4508dd5-d98c-4b41-8d04-32a5724e6ff1 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:36.715634 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c4508dd5-d98c-4b41-8d04-32a5724e6ff1 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:36.723513 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c4508dd5-d98c-4b41-8d04-32a5724e6ff1 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:36.723973 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c4508dd5-d98c-4b41-8d04-32a5724e6ff1 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:36.724785 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c4508dd5-d98c-4b41-8d04-32a5724e6ff1 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:36.725224 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c4508dd5-d98c-4b41-8d04-32a5724e6ff1 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:36.873237 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c4508dd5-d98c-4b41-8d04-32a5724e6ff1 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:36.885309 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c4508dd5-d98c-4b41-8d04-32a5724e6ff1 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:36.886898 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c4508dd5-d98c-4b41-8d04-32a5724e6ff1 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:36.888055 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c4508dd5-d98c-4b41-8d04-32a5724e6ff1 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1740 microversion: 2.20 time: 0.177287 Jun 08 02:11:36.888629 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 348/683] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:11:36 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:11:37.516996 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-35e064be-2633-41b5-b74e-0b16fc0bd727 req-a91ee394-09f5-46cc-ae65-3cf7569035e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19726b62-06f4-4547-9021-b58c9571f183", "name": "network-vif-plugged", "status": "completed", "tag": "92dccdf3-f4c8-42b5-aee4-d2373577dd65"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:11:37.530072 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-35e064be-2633-41b5-b74e-0b16fc0bd727 req-a91ee394-09f5-46cc-ae65-3cf7569035e3 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:37.531317 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-35e064be-2633-41b5-b74e-0b16fc0bd727 req-a91ee394-09f5-46cc-ae65-3cf7569035e3 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:37.544539 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-35e064be-2633-41b5-b74e-0b16fc0bd727 req-a91ee394-09f5-46cc-ae65-3cf7569035e3 service nova] Creating event network-vif-plugged:92dccdf3-f4c8-42b5-aee4-d2373577dd65 for instance 19726b62-06f4-4547-9021-b58c9571f183 on hv-cinder-84506 Jun 08 02:11:37.549603 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-35e064be-2633-41b5-b74e-0b16fc0bd727 req-a91ee394-09f5-46cc-ae65-3cf7569035e3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036679 Jun 08 02:11:37.550302 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 336/684] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 02:11:37.907687 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-4afbd2df-8f17-47ee-a141-90ae8eabbc4f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:37.917711 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-4afbd2df-8f17-47ee-a141-90ae8eabbc4f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:37.925799 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4afbd2df-8f17-47ee-a141-90ae8eabbc4f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:37.926248 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4afbd2df-8f17-47ee-a141-90ae8eabbc4f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:37.927251 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4afbd2df-8f17-47ee-a141-90ae8eabbc4f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:37.927694 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4afbd2df-8f17-47ee-a141-90ae8eabbc4f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:38.119781 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-4afbd2df-8f17-47ee-a141-90ae8eabbc4f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:38.128816 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-4afbd2df-8f17-47ee-a141-90ae8eabbc4f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:38.130278 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-4afbd2df-8f17-47ee-a141-90ae8eabbc4f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:38.133306 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-4afbd2df-8f17-47ee-a141-90ae8eabbc4f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1740 microversion: 2.20 time: 0.229681 Jun 08 02:11:38.137562 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 349/685] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:11:37 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1740 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 02:11:39.157323 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-efd3fdeb-8c2a-4441-8450-c32b609019de tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:39.157975 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-efd3fdeb-8c2a-4441-8450-c32b609019de tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:39.165987 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-efd3fdeb-8c2a-4441-8450-c32b609019de tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:39.166705 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-efd3fdeb-8c2a-4441-8450-c32b609019de tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:39.167708 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-efd3fdeb-8c2a-4441-8450-c32b609019de tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:39.168571 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-efd3fdeb-8c2a-4441-8450-c32b609019de tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:39.329228 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-efd3fdeb-8c2a-4441-8450-c32b609019de tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:39.338044 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-efd3fdeb-8c2a-4441-8450-c32b609019de tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:39.339559 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-efd3fdeb-8c2a-4441-8450-c32b609019de tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:39.340770 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-efd3fdeb-8c2a-4441-8450-c32b609019de tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1740 microversion: 2.20 time: 0.189334 Jun 08 02:11:39.352154 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 337/686] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:11:39 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1740 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:11:40.360891 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-adaee18d-4a60-488a-be50-f4bbbcc09974 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:40.361732 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-adaee18d-4a60-488a-be50-f4bbbcc09974 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:40.377945 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-adaee18d-4a60-488a-be50-f4bbbcc09974 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:40.378667 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-adaee18d-4a60-488a-be50-f4bbbcc09974 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:40.379629 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-adaee18d-4a60-488a-be50-f4bbbcc09974 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:40.380068 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-adaee18d-4a60-488a-be50-f4bbbcc09974 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:40.555934 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-adaee18d-4a60-488a-be50-f4bbbcc09974 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:40.558647 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=100 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:11:40.568640 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-adaee18d-4a60-488a-be50-f4bbbcc09974 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:40.571647 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-adaee18d-4a60-488a-be50-f4bbbcc09974 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:40.573153 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-adaee18d-4a60-488a-be50-f4bbbcc09974 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1740 microversion: 2.20 time: 0.218187 Jun 08 02:11:40.574529 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 350/687] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:11:40 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1740 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:11:40.638668 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4d2b344f-6ab6-41bb-9e2c-2f8673ddf134 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:40.639870 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4d2b344f-6ab6-41bb-9e2c-2f8673ddf134 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: 111070da-9d8e-487a-8e32-60e64894d5a9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:40.659046 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4d2b344f-6ab6-41bb-9e2c-2f8673ddf134 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:40.660830 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4d2b344f-6ab6-41bb-9e2c-2f8673ddf134 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:40.662488 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4d2b344f-6ab6-41bb-9e2c-2f8673ddf134 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:40.663243 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4d2b344f-6ab6-41bb-9e2c-2f8673ddf134 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:40.700018 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4d2b344f-6ab6-41bb-9e2c-2f8673ddf134 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9/ips" status: 200 len: 147 microversion: 2.1 time: 0.069252 Jun 08 02:11:40.700893 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 338/688] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Jun 8 02:11:40 2022] GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9/ips => generated 147 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:11:41.592864 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f7fa5c2e-1210-4582-a3c5-ae031dbbbf39 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:41.593489 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f7fa5c2e-1210-4582-a3c5-ae031dbbbf39 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:41.599930 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f7fa5c2e-1210-4582-a3c5-ae031dbbbf39 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:41.601084 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f7fa5c2e-1210-4582-a3c5-ae031dbbbf39 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:41.601867 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f7fa5c2e-1210-4582-a3c5-ae031dbbbf39 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:41.610025 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f7fa5c2e-1210-4582-a3c5-ae031dbbbf39 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:41.793315 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f7fa5c2e-1210-4582-a3c5-ae031dbbbf39 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:41.803096 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f7fa5c2e-1210-4582-a3c5-ae031dbbbf39 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:41.805699 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f7fa5c2e-1210-4582-a3c5-ae031dbbbf39 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:41.807315 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f7fa5c2e-1210-4582-a3c5-ae031dbbbf39 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1740 microversion: 2.20 time: 0.218990 Jun 08 02:11:41.808105 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 351/689] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:11:41 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1740 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:11:42.327043 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-60b4aec2-6bc0-4372-b806-0c656083b0c2 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76f4720e-f95f-496f-bcfb-a10bb877190b"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:11:42.337722 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-60b4aec2-6bc0-4372-b806-0c656083b0c2 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: 111070da-9d8e-487a-8e32-60e64894d5a9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:42.355276 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-60b4aec2-6bc0-4372-b806-0c656083b0c2 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:42.356074 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-60b4aec2-6bc0-4372-b806-0c656083b0c2 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:42.357084 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-60b4aec2-6bc0-4372-b806-0c656083b0c2 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:42.357717 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-60b4aec2-6bc0-4372-b806-0c656083b0c2 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:42.827061 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-1aef2beb-25a3-4f81-b889-be470bc207fe tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:42.828388 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-1aef2beb-25a3-4f81-b889-be470bc207fe tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:42.848876 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1aef2beb-25a3-4f81-b889-be470bc207fe tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:42.849743 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1aef2beb-25a3-4f81-b889-be470bc207fe tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:42.850861 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1aef2beb-25a3-4f81-b889-be470bc207fe tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:42.851493 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1aef2beb-25a3-4f81-b889-be470bc207fe tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:42.873137 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-60b4aec2-6bc0-4372-b806-0c656083b0c2 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "POST /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.554582 Jun 08 02:11:42.874599 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 339/690] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jun 8 02:11:42 2022] POST /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9/os-volume_attachments => generated 194 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:11:43.505352 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1aef2beb-25a3-4f81-b889-be470bc207fe tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:43.516211 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1aef2beb-25a3-4f81-b889-be470bc207fe tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:43.521901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1aef2beb-25a3-4f81-b889-be470bc207fe tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:43.524897 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-1aef2beb-25a3-4f81-b889-be470bc207fe tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1740 microversion: 2.20 time: 0.702285 Jun 08 02:11:43.528913 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 352/691] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:11:42 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1740 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 02:11:44.565072 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a2909c1d-787e-42c5-8ee6-22ae84304d1a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:44.566295 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a2909c1d-787e-42c5-8ee6-22ae84304d1a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:44.576772 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a2909c1d-787e-42c5-8ee6-22ae84304d1a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:44.578083 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a2909c1d-787e-42c5-8ee6-22ae84304d1a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:44.579020 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a2909c1d-787e-42c5-8ee6-22ae84304d1a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:44.579606 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a2909c1d-787e-42c5-8ee6-22ae84304d1a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:44.920049 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a2909c1d-787e-42c5-8ee6-22ae84304d1a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:44.929731 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a2909c1d-787e-42c5-8ee6-22ae84304d1a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:44.939293 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a2909c1d-787e-42c5-8ee6-22ae84304d1a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:44.944982 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a2909c1d-787e-42c5-8ee6-22ae84304d1a tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1740 microversion: 2.20 time: 0.400817 Jun 08 02:11:44.947351 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 340/692] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:11:44 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1740 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:11:45.963447 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ab9ea2f4-2468-4eb9-a8ad-41dde12fe248 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:45.964099 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ab9ea2f4-2468-4eb9-a8ad-41dde12fe248 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:45.971243 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ab9ea2f4-2468-4eb9-a8ad-41dde12fe248 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:45.971894 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ab9ea2f4-2468-4eb9-a8ad-41dde12fe248 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:45.973100 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ab9ea2f4-2468-4eb9-a8ad-41dde12fe248 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:45.973712 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ab9ea2f4-2468-4eb9-a8ad-41dde12fe248 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:46.153401 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ab9ea2f4-2468-4eb9-a8ad-41dde12fe248 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:46.167232 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ab9ea2f4-2468-4eb9-a8ad-41dde12fe248 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:46.170747 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ab9ea2f4-2468-4eb9-a8ad-41dde12fe248 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:46.174514 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ab9ea2f4-2468-4eb9-a8ad-41dde12fe248 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1740 microversion: 2.20 time: 0.215195 Jun 08 02:11:46.175529 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 353/693] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:11:45 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1740 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:11:47.203386 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cc38c4a3-235b-46b6-97dc-78c3796c0e98 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:47.205168 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-cc38c4a3-235b-46b6-97dc-78c3796c0e98 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:47.214749 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cc38c4a3-235b-46b6-97dc-78c3796c0e98 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:47.215549 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cc38c4a3-235b-46b6-97dc-78c3796c0e98 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:47.216454 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cc38c4a3-235b-46b6-97dc-78c3796c0e98 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:47.217124 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cc38c4a3-235b-46b6-97dc-78c3796c0e98 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:47.463185 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-cc38c4a3-235b-46b6-97dc-78c3796c0e98 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:47.471903 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-cc38c4a3-235b-46b6-97dc-78c3796c0e98 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:47.473428 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-cc38c4a3-235b-46b6-97dc-78c3796c0e98 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:47.474892 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-cc38c4a3-235b-46b6-97dc-78c3796c0e98 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1722 microversion: 2.20 time: 0.279795 Jun 08 02:11:47.486406 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 341/694] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:11:47 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1722 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:11:48.500911 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-cb908291-7dd5-498a-868a-eb675db78233 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:48.502167 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-cb908291-7dd5-498a-868a-eb675db78233 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:48.512374 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cb908291-7dd5-498a-868a-eb675db78233 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:48.513035 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cb908291-7dd5-498a-868a-eb675db78233 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:48.513900 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cb908291-7dd5-498a-868a-eb675db78233 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:48.514670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cb908291-7dd5-498a-868a-eb675db78233 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:48.819246 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-cb908291-7dd5-498a-868a-eb675db78233 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:48.843389 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-cb908291-7dd5-498a-868a-eb675db78233 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:48.860165 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-cb908291-7dd5-498a-868a-eb675db78233 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:48.862185 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-cb908291-7dd5-498a-868a-eb675db78233 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1722 microversion: 2.20 time: 0.369844 Jun 08 02:11:48.863021 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 354/695] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:11:48 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1722 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:11:50.355176 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-fcbfa311-589f-48f9-9947-c3210878affc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:50.358829 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-fcbfa311-589f-48f9-9947-c3210878affc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:50.368613 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fcbfa311-589f-48f9-9947-c3210878affc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:50.369889 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fcbfa311-589f-48f9-9947-c3210878affc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:50.375200 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fcbfa311-589f-48f9-9947-c3210878affc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:50.376515 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fcbfa311-589f-48f9-9947-c3210878affc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:50.614745 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fcbfa311-589f-48f9-9947-c3210878affc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:50.629285 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fcbfa311-589f-48f9-9947-c3210878affc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:50.631763 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fcbfa311-589f-48f9-9947-c3210878affc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:50.632363 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-fcbfa311-589f-48f9-9947-c3210878affc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1725 microversion: 2.20 time: 0.755483 Jun 08 02:11:50.641139 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 342/696] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:11:49 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1725 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:11:50.664990 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-01eecbae-0fea-407b-bb28-302413ebcde9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e474490-d3dd-41a6-a56d-1e069b65efae"}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:11:50.667420 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-01eecbae-0fea-407b-bb28-302413ebcde9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:50.702230 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-01eecbae-0fea-407b-bb28-302413ebcde9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:50.706004 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-01eecbae-0fea-407b-bb28-302413ebcde9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:50.707259 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-01eecbae-0fea-407b-bb28-302413ebcde9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:50.714875 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-01eecbae-0fea-407b-bb28-302413ebcde9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:51.298294 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-01eecbae-0fea-407b-bb28-302413ebcde9 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "POST /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.639944 Jun 08 02:11:51.298960 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 355/697] 10.222.0.20 () {62 vars in 1363 bytes} [Wed Jun 8 02:11:50 2022] POST /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183/os-volume_attachments => generated 188 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 08 02:11:51.439127 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d5093467-eda3-4f60-91ed-bca8f7a430ed tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:51.440175 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d5093467-eda3-4f60-91ed-bca8f7a430ed tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:51.447805 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d5093467-eda3-4f60-91ed-bca8f7a430ed tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:51.448604 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d5093467-eda3-4f60-91ed-bca8f7a430ed tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:51.449689 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d5093467-eda3-4f60-91ed-bca8f7a430ed tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:51.450293 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d5093467-eda3-4f60-91ed-bca8f7a430ed tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:51.624753 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-ff387807-73e9-44d0-aff6-ed322290ae73 req-ac56979c-3fbc-4c58-b339-8310d62dcd96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19726b62-06f4-4547-9021-b58c9571f183", "name": "network-vif-unplugged", "status": "completed", "tag": "92dccdf3-f4c8-42b5-aee4-d2373577dd65"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:11:51.633589 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-ff387807-73e9-44d0-aff6-ed322290ae73 req-ac56979c-3fbc-4c58-b339-8310d62dcd96 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:51.634065 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-ff387807-73e9-44d0-aff6-ed322290ae73 req-ac56979c-3fbc-4c58-b339-8310d62dcd96 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:51.662557 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.compute.server_external_events [req-ff387807-73e9-44d0-aff6-ed322290ae73 req-ac56979c-3fbc-4c58-b339-8310d62dcd96 service nova] Unable to find a host for instance 19726b62-06f4-4547-9021-b58c9571f183. Dropping event network-vif-unplugged {{(pid=117939) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 08 02:11:51.668608 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-ff387807-73e9-44d0-aff6-ed322290ae73 req-ac56979c-3fbc-4c58-b339-8310d62dcd96 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.048737 Jun 08 02:11:51.670108 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 356/698] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 55 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 08 02:11:51.955350 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-fdcfe2a1-adfc-45f6-ae36-988f10f6a5dd tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:51.958317 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-fdcfe2a1-adfc-45f6-ae36-988f10f6a5dd tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: 111070da-9d8e-487a-8e32-60e64894d5a9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:51.966047 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fdcfe2a1-adfc-45f6-ae36-988f10f6a5dd tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:51.966584 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fdcfe2a1-adfc-45f6-ae36-988f10f6a5dd tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:51.967425 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fdcfe2a1-adfc-45f6-ae36-988f10f6a5dd tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:51.967929 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fdcfe2a1-adfc-45f6-ae36-988f10f6a5dd tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:52.005237 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-fdcfe2a1-adfc-45f6-ae36-988f10f6a5dd tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053656 Jun 08 02:11:52.006055 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 357/699] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jun 8 02:11:51 2022] GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:11:52.016809 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-025da384-fceb-4177-bf33-1b6ea574e7dc tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:52.017325 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-025da384-fceb-4177-bf33-1b6ea574e7dc tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: 111070da-9d8e-487a-8e32-60e64894d5a9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:52.023857 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-025da384-fceb-4177-bf33-1b6ea574e7dc tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:52.024312 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-025da384-fceb-4177-bf33-1b6ea574e7dc tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:52.025124 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-025da384-fceb-4177-bf33-1b6ea574e7dc tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:52.025561 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-025da384-fceb-4177-bf33-1b6ea574e7dc tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:52.059490 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-025da384-fceb-4177-bf33-1b6ea574e7dc tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9/os-volume_attachments/76f4720e-f95f-496f-bcfb-a10bb877190b" status: 200 len: 194 microversion: 2.1 time: 0.046843 Jun 08 02:11:52.060512 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 358/700] 10.222.0.20 () {58 vars in 1412 bytes} [Wed Jun 8 02:11:52 2022] GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9/os-volume_attachments/76f4720e-f95f-496f-bcfb-a10bb877190b => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 02:11:52.064318 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d5093467-eda3-4f60-91ed-bca8f7a430ed tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "DELETE /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183/os-volume_attachments/3e474490-d3dd-41a6-a56d-1e069b65efae" status: 202 len: 0 microversion: 2.20 time: 0.629094 Jun 08 02:11:52.065391 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 343/701] 10.222.0.20 () {60 vars in 1456 bytes} [Wed Jun 8 02:11:51 2022] DELETE /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183/os-volume_attachments/3e474490-d3dd-41a6-a56d-1e069b65efae => generated 0 bytes in 631 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 08 02:11:52.152031 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a933dc57-5482-47f7-9a7d-b9764381b139 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:11:52.153060 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a933dc57-5482-47f7-9a7d-b9764381b139 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:52.160466 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a933dc57-5482-47f7-9a7d-b9764381b139 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:52.160918 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a933dc57-5482-47f7-9a7d-b9764381b139 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:52.165482 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a933dc57-5482-47f7-9a7d-b9764381b139 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:52.166165 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a933dc57-5482-47f7-9a7d-b9764381b139 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:52.272483 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a933dc57-5482-47f7-9a7d-b9764381b139 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "POST /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183/action" status: 202 len: 0 microversion: 2.20 time: 0.125384 Jun 08 02:11:52.276817 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 359/702] 10.222.0.20 () {62 vars in 1318 bytes} [Wed Jun 8 02:11:52 2022] POST /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 08 02:11:52.281393 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a6a10f36-3988-4ed5-a0ec-2e4c8510f838 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:52.282020 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a6a10f36-3988-4ed5-a0ec-2e4c8510f838 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:52.289784 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a6a10f36-3988-4ed5-a0ec-2e4c8510f838 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:52.290281 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a6a10f36-3988-4ed5-a0ec-2e4c8510f838 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:52.291049 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a6a10f36-3988-4ed5-a0ec-2e4c8510f838 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:52.291519 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a6a10f36-3988-4ed5-a0ec-2e4c8510f838 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:52.505910 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a6a10f36-3988-4ed5-a0ec-2e4c8510f838 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:52.520071 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a6a10f36-3988-4ed5-a0ec-2e4c8510f838 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:52.522097 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a6a10f36-3988-4ed5-a0ec-2e4c8510f838 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:52.523667 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a6a10f36-3988-4ed5-a0ec-2e4c8510f838 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1673 microversion: 2.20 time: 0.246224 Jun 08 02:11:52.535057 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 344/703] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:11:52 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1673 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:11:53.543194 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c807e1d6-43b9-492c-85ad-00177f5d9fb3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:53.547138 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c807e1d6-43b9-492c-85ad-00177f5d9fb3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:53.561115 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c807e1d6-43b9-492c-85ad-00177f5d9fb3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:53.561762 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c807e1d6-43b9-492c-85ad-00177f5d9fb3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:53.564760 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c807e1d6-43b9-492c-85ad-00177f5d9fb3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:53.565376 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c807e1d6-43b9-492c-85ad-00177f5d9fb3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:53.596212 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-310bfbbd-e154-4d0b-9366-a5d102dbb68f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7893e98-04db-4d64-90c1-4a89a9e19ec9"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:11:53.597512 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-310bfbbd-e154-4d0b-9366-a5d102dbb68f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: 111070da-9d8e-487a-8e32-60e64894d5a9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:53.610290 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-310bfbbd-e154-4d0b-9366-a5d102dbb68f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:53.610883 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-310bfbbd-e154-4d0b-9366-a5d102dbb68f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:53.611667 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-310bfbbd-e154-4d0b-9366-a5d102dbb68f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:53.612109 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-310bfbbd-e154-4d0b-9366-a5d102dbb68f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:53.752160 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c807e1d6-43b9-492c-85ad-00177f5d9fb3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:53.767608 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c807e1d6-43b9-492c-85ad-00177f5d9fb3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:53.769859 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c807e1d6-43b9-492c-85ad-00177f5d9fb3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:53.771381 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c807e1d6-43b9-492c-85ad-00177f5d9fb3 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1675 microversion: 2.20 time: 0.232574 Jun 08 02:11:53.773886 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 360/704] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:11:53 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1675 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:11:54.304219 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-310bfbbd-e154-4d0b-9366-a5d102dbb68f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "POST /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.710062 Jun 08 02:11:54.325586 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 345/705] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jun 8 02:11:53 2022] POST /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9/os-volume_attachments => generated 194 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 02:11:54.792378 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-97799189-e2b4-40ec-bf41-782ba0d0a817 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:54.792996 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-97799189-e2b4-40ec-bf41-782ba0d0a817 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:54.795296 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=48 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:11:54.813981 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-97799189-e2b4-40ec-bf41-782ba0d0a817 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:54.814418 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-97799189-e2b4-40ec-bf41-782ba0d0a817 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:54.815189 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-97799189-e2b4-40ec-bf41-782ba0d0a817 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:54.815715 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-97799189-e2b4-40ec-bf41-782ba0d0a817 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:55.096304 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-97799189-e2b4-40ec-bf41-782ba0d0a817 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:55.111948 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-97799189-e2b4-40ec-bf41-782ba0d0a817 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:55.115781 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-97799189-e2b4-40ec-bf41-782ba0d0a817 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:55.117328 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-97799189-e2b4-40ec-bf41-782ba0d0a817 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1731 microversion: 2.20 time: 0.330057 Jun 08 02:11:55.128441 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 361/706] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:11:54 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1731 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:11:56.142768 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-98e958ac-f24d-4a88-9432-706af8079120 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:56.144512 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-98e958ac-f24d-4a88-9432-706af8079120 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:56.148365 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=40 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:11:56.165041 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-98e958ac-f24d-4a88-9432-706af8079120 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:56.165509 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-98e958ac-f24d-4a88-9432-706af8079120 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:56.166678 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-98e958ac-f24d-4a88-9432-706af8079120 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:56.168985 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-98e958ac-f24d-4a88-9432-706af8079120 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:56.378633 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-98e958ac-f24d-4a88-9432-706af8079120 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:56.394706 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-98e958ac-f24d-4a88-9432-706af8079120 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:56.402503 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-98e958ac-f24d-4a88-9432-706af8079120 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:56.404840 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-98e958ac-f24d-4a88-9432-706af8079120 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1731 microversion: 2.20 time: 0.270617 Jun 08 02:11:56.406467 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 346/707] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:11:56 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1731 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:11:57.426282 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-16803ac4-cdd1-4513-a50e-526e1303d00f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:57.426871 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-16803ac4-cdd1-4513-a50e-526e1303d00f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:57.449080 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-16803ac4-cdd1-4513-a50e-526e1303d00f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:57.449532 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-16803ac4-cdd1-4513-a50e-526e1303d00f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:57.450318 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-16803ac4-cdd1-4513-a50e-526e1303d00f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:57.450752 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-16803ac4-cdd1-4513-a50e-526e1303d00f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:57.811368 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-16803ac4-cdd1-4513-a50e-526e1303d00f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:57.820563 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-16803ac4-cdd1-4513-a50e-526e1303d00f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:57.822103 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-16803ac4-cdd1-4513-a50e-526e1303d00f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:57.823283 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-16803ac4-cdd1-4513-a50e-526e1303d00f tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1731 microversion: 2.20 time: 0.401268 Jun 08 02:11:57.823845 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 362/708] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:11:57 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1731 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:11:58.847063 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0df41c4f-d924-470c-9854-fdd8c0a6784c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:11:58.847696 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0df41c4f-d924-470c-9854-fdd8c0a6784c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:11:58.864625 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0df41c4f-d924-470c-9854-fdd8c0a6784c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:58.865079 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0df41c4f-d924-470c-9854-fdd8c0a6784c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:58.866390 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0df41c4f-d924-470c-9854-fdd8c0a6784c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:11:58.866916 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0df41c4f-d924-470c-9854-fdd8c0a6784c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:11:59.263326 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0df41c4f-d924-470c-9854-fdd8c0a6784c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:59.268190 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=8,nova_cell1:INSERT=4 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:11:59.277784 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0df41c4f-d924-470c-9854-fdd8c0a6784c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:59.279675 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0df41c4f-d924-470c-9854-fdd8c0a6784c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:11:59.281232 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0df41c4f-d924-470c-9854-fdd8c0a6784c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1731 microversion: 2.20 time: 0.438399 Jun 08 02:11:59.282094 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 347/709] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:11:58 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1731 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:12:00.301408 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-eaecfae0-c2f6-471e-ac8b-7206db4c3032 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:00.302887 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-eaecfae0-c2f6-471e-ac8b-7206db4c3032 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:00.315885 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eaecfae0-c2f6-471e-ac8b-7206db4c3032 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:00.328853 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eaecfae0-c2f6-471e-ac8b-7206db4c3032 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:00.329910 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eaecfae0-c2f6-471e-ac8b-7206db4c3032 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:00.331094 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eaecfae0-c2f6-471e-ac8b-7206db4c3032 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:00.517561 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-eaecfae0-c2f6-471e-ac8b-7206db4c3032 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:00.526794 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-eaecfae0-c2f6-471e-ac8b-7206db4c3032 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:00.529065 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-eaecfae0-c2f6-471e-ac8b-7206db4c3032 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:00.530559 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-eaecfae0-c2f6-471e-ac8b-7206db4c3032 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1731 microversion: 2.20 time: 0.233452 Jun 08 02:12:00.542406 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 363/710] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:12:00 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1731 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:12:01.552673 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-01eb6bb7-e139-4bcb-b602-7ee20f8a3364 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:01.554140 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-01eb6bb7-e139-4bcb-b602-7ee20f8a3364 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:01.568515 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-01eb6bb7-e139-4bcb-b602-7ee20f8a3364 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:01.570021 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-01eb6bb7-e139-4bcb-b602-7ee20f8a3364 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:01.571062 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-01eb6bb7-e139-4bcb-b602-7ee20f8a3364 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:01.571718 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-01eb6bb7-e139-4bcb-b602-7ee20f8a3364 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:01.839700 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-01eb6bb7-e139-4bcb-b602-7ee20f8a3364 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:01.850003 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-01eb6bb7-e139-4bcb-b602-7ee20f8a3364 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:01.853095 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-01eb6bb7-e139-4bcb-b602-7ee20f8a3364 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:01.854281 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-01eb6bb7-e139-4bcb-b602-7ee20f8a3364 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1731 microversion: 2.20 time: 0.308708 Jun 08 02:12:01.867724 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 348/711] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:12:01 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1731 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:12:02.878036 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-1d8d71b5-6403-4edd-9c35-1e7d9673c725 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:02.879455 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-1d8d71b5-6403-4edd-9c35-1e7d9673c725 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:02.887986 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1d8d71b5-6403-4edd-9c35-1e7d9673c725 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:02.888866 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1d8d71b5-6403-4edd-9c35-1e7d9673c725 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:02.889886 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1d8d71b5-6403-4edd-9c35-1e7d9673c725 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:02.890444 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1d8d71b5-6403-4edd-9c35-1e7d9673c725 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:02.923058 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:12:03.115184 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1d8d71b5-6403-4edd-9c35-1e7d9673c725 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:03.124380 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1d8d71b5-6403-4edd-9c35-1e7d9673c725 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:03.125934 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1d8d71b5-6403-4edd-9c35-1e7d9673c725 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:03.127102 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-1d8d71b5-6403-4edd-9c35-1e7d9673c725 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1731 microversion: 2.20 time: 0.253315 Jun 08 02:12:03.127663 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 364/712] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:12:02 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1731 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:12:03.421094 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-812df96f-bf56-43b3-84c9-6a769e1b0152 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Action: 'create', calling method: .version_select at 0x7f836af02940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1419205293", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQHHkTGw49P/flZOC0qAJ2AJvs6062bLZciX5lZm966JoUlNR46Q8oAQAWJYDQRcDkSLlbbve1zou+r9umNML23HXCkX/IviaFpBX4FR6wWORcnDDNuWWqviIpBK6PmHA=="}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:12:03.435631 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-812df96f-bf56-43b3-84c9-6a769e1b0152 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Getting quotas for project 3b0724451ec94fdbb4f2422c44245b53. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 02:12:03.439364 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-812df96f-bf56-43b3-84c9-6a769e1b0152 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Getting quotas for user 2f0ae440fa644f1296d2b474c5335ffc and project 3b0724451ec94fdbb4f2422c44245b53. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 02:12:03.461395 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-812df96f-bf56-43b3-84c9-6a769e1b0152 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.044059 Jun 08 02:12:03.461982 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 349/713] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jun 8 02:12:03 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:12:03.509698 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-27627311-9c74-4b6f-916c-eb04e1b68931 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1578698406", "imageRef": "2b4a22e1-ba74-4c2f-9981-132383c43fde", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1419205293", "networks": [{"uuid": "29b8f254-b98d-401b-bc5d-7cbf19e5b50d"}]}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:12:03.558210 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.network.neutron [None req-27627311-9c74-4b6f-916c-eb04e1b68931 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] validate_networks() for [('29b8f254-b98d-401b-bc5d-7cbf19e5b50d', None, None, None, None, None)] {{(pid=117939) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 02:12:04.023183 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-27627311-9c74-4b6f-916c-eb04e1b68931 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Flavor limits 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 02:12:04.023836 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-27627311-9c74-4b6f-916c-eb04e1b68931 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Image limits 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 02:12:04.024533 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-27627311-9c74-4b6f-916c-eb04e1b68931 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Flavor pref 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 02:12:04.025529 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-27627311-9c74-4b6f-916c-eb04e1b68931 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Image pref 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 02:12:04.025529 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-27627311-9c74-4b6f-916c-eb04e1b68931 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 02:12:04.044330 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-27627311-9c74-4b6f-916c-eb04e1b68931 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:04.045202 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-27627311-9c74-4b6f-916c-eb04e1b68931 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:04.046396 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-27627311-9c74-4b6f-916c-eb04e1b68931 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:04.046938 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-27627311-9c74-4b6f-916c-eb04e1b68931 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:04.070420 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-27627311-9c74-4b6f-916c-eb04e1b68931 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Getting quotas for project 3b0724451ec94fdbb4f2422c44245b53. Resources: {'cores', 'ram', 'instances'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 02:12:04.081743 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-27627311-9c74-4b6f-916c-eb04e1b68931 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Getting quotas for user 2f0ae440fa644f1296d2b474c5335ffc and project 3b0724451ec94fdbb4f2422c44245b53. Resources: {'cores', 'ram', 'instances'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 02:12:04.095718 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-27627311-9c74-4b6f-916c-eb04e1b68931 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Going to run 1 instances... {{(pid=117939) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 02:12:04.098083 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-27627311-9c74-4b6f-916c-eb04e1b68931 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b4a22e1-ba74-4c2f-9981-132383c43fde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 02:12:04.152677 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-89aa9b86-06c6-4c05-a982-9ea82f5b2ad5 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:04.153557 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-89aa9b86-06c6-4c05-a982-9ea82f5b2ad5 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:04.161906 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-89aa9b86-06c6-4c05-a982-9ea82f5b2ad5 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:04.163565 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-89aa9b86-06c6-4c05-a982-9ea82f5b2ad5 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:04.166283 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-89aa9b86-06c6-4c05-a982-9ea82f5b2ad5 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:04.167108 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-89aa9b86-06c6-4c05-a982-9ea82f5b2ad5 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:04.172350 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-27627311-9c74-4b6f-916c-eb04e1b68931 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.666390 Jun 08 02:12:04.175250 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 365/714] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jun 8 02:12:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 08 02:12:04.191319 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-aa7d2b66-01e4-40d2-95d4-84d8be7ae13f tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:04.192557 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-aa7d2b66-01e4-40d2-95d4-84d8be7ae13f tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:04.283178 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-aa7d2b66-01e4-40d2-95d4-84d8be7ae13f tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:04.301973 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-aa7d2b66-01e4-40d2-95d4-84d8be7ae13f tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1259 microversion: 2.1 time: 0.115774 Jun 08 02:12:04.312091 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 366/715] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:12:04 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1259 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:12:04.423142 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-89aa9b86-06c6-4c05-a982-9ea82f5b2ad5 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:04.436263 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-89aa9b86-06c6-4c05-a982-9ea82f5b2ad5 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:04.437808 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-89aa9b86-06c6-4c05-a982-9ea82f5b2ad5 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:04.439507 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-89aa9b86-06c6-4c05-a982-9ea82f5b2ad5 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1731 microversion: 2.20 time: 0.296317 Jun 08 02:12:04.440162 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 350/716] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:12:04 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1731 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:12:05.320978 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-415e44dd-846d-4cf3-b4f2-1cb265bd060b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:05.322067 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-415e44dd-846d-4cf3-b4f2-1cb265bd060b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:05.333738 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-415e44dd-846d-4cf3-b4f2-1cb265bd060b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:05.334513 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-415e44dd-846d-4cf3-b4f2-1cb265bd060b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:05.335531 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-415e44dd-846d-4cf3-b4f2-1cb265bd060b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:05.336162 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-415e44dd-846d-4cf3-b4f2-1cb265bd060b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:05.401106 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-415e44dd-846d-4cf3-b4f2-1cb265bd060b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:05.408734 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-415e44dd-846d-4cf3-b4f2-1cb265bd060b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1263 microversion: 2.1 time: 0.093143 Jun 08 02:12:05.409289 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 367/717] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:12:05 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1263 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:12:05.458320 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4d22e1a2-a4b3-4467-a258-11e4e20b0959 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:05.458824 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4d22e1a2-a4b3-4467-a258-11e4e20b0959 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:05.465525 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4d22e1a2-a4b3-4467-a258-11e4e20b0959 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:05.465963 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4d22e1a2-a4b3-4467-a258-11e4e20b0959 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:05.466718 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4d22e1a2-a4b3-4467-a258-11e4e20b0959 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:05.467147 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4d22e1a2-a4b3-4467-a258-11e4e20b0959 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:05.593746 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4d22e1a2-a4b3-4467-a258-11e4e20b0959 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:05.601807 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4d22e1a2-a4b3-4467-a258-11e4e20b0959 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:05.603299 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4d22e1a2-a4b3-4467-a258-11e4e20b0959 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:05.604484 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4d22e1a2-a4b3-4467-a258-11e4e20b0959 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1731 microversion: 2.20 time: 0.150122 Jun 08 02:12:05.605034 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 351/718] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:12:05 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:12:06.347312 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f613825d-a22f-4d14-9a28-1a6451b2c60e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:06.348280 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f613825d-a22f-4d14-9a28-1a6451b2c60e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: 111070da-9d8e-487a-8e32-60e64894d5a9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:06.355271 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f613825d-a22f-4d14-9a28-1a6451b2c60e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:06.355710 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f613825d-a22f-4d14-9a28-1a6451b2c60e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:06.356478 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f613825d-a22f-4d14-9a28-1a6451b2c60e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:06.356905 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f613825d-a22f-4d14-9a28-1a6451b2c60e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:06.385740 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f613825d-a22f-4d14-9a28-1a6451b2c60e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042304 Jun 08 02:12:06.386283 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 368/719] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jun 8 02:12:06 2022] GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:12:06.425404 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-faee3aa0-1cf0-46ae-b4d9-ea633f6b6096 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:06.426004 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-faee3aa0-1cf0-46ae-b4d9-ea633f6b6096 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:06.432730 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-faee3aa0-1cf0-46ae-b4d9-ea633f6b6096 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:06.433171 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-faee3aa0-1cf0-46ae-b4d9-ea633f6b6096 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:06.433918 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-faee3aa0-1cf0-46ae-b4d9-ea633f6b6096 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:06.434346 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-faee3aa0-1cf0-46ae-b4d9-ea633f6b6096 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:06.498223 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-faee3aa0-1cf0-46ae-b4d9-ea633f6b6096 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:06.506219 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-faee3aa0-1cf0-46ae-b4d9-ea633f6b6096 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1311 microversion: 2.1 time: 0.084628 Jun 08 02:12:06.506845 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 352/720] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:12:06 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1311 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:12:06.526230 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-45c63e6e-b452-4dcd-90fd-ac5a7b16efbe tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:06.526729 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-45c63e6e-b452-4dcd-90fd-ac5a7b16efbe tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: 111070da-9d8e-487a-8e32-60e64894d5a9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:06.533037 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-45c63e6e-b452-4dcd-90fd-ac5a7b16efbe tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:06.533488 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-45c63e6e-b452-4dcd-90fd-ac5a7b16efbe tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:06.534258 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-45c63e6e-b452-4dcd-90fd-ac5a7b16efbe tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:06.534696 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-45c63e6e-b452-4dcd-90fd-ac5a7b16efbe tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:06.566526 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-45c63e6e-b452-4dcd-90fd-ac5a7b16efbe tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9/os-volume_attachments/76f4720e-f95f-496f-bcfb-a10bb877190b" status: 200 len: 194 microversion: 2.1 time: 0.044168 Jun 08 02:12:06.567704 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 369/721] 10.222.0.20 () {58 vars in 1412 bytes} [Wed Jun 8 02:12:06 2022] GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9/os-volume_attachments/76f4720e-f95f-496f-bcfb-a10bb877190b => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:12:06.577372 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a01f8625-fef2-4bbb-bd40-d956927edc47 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:06.577944 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a01f8625-fef2-4bbb-bd40-d956927edc47 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: 111070da-9d8e-487a-8e32-60e64894d5a9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:06.584049 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a01f8625-fef2-4bbb-bd40-d956927edc47 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:06.584532 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a01f8625-fef2-4bbb-bd40-d956927edc47 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:06.585408 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a01f8625-fef2-4bbb-bd40-d956927edc47 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:06.586014 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a01f8625-fef2-4bbb-bd40-d956927edc47 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:06.624826 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-3cb053f3-9a0f-4498-90fe-1f158e2cc418 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:06.628688 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-3cb053f3-9a0f-4498-90fe-1f158e2cc418 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:06.639619 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3cb053f3-9a0f-4498-90fe-1f158e2cc418 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:06.640335 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3cb053f3-9a0f-4498-90fe-1f158e2cc418 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:06.641289 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3cb053f3-9a0f-4498-90fe-1f158e2cc418 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:06.641725 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3cb053f3-9a0f-4498-90fe-1f158e2cc418 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:06.683418 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-a01f8625-fef2-4bbb-bd40-d956927edc47 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lazy-loading 'services' on Instance uuid 111070da-9d8e-487a-8e32-60e64894d5a9 {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 02:12:06.765318 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a01f8625-fef2-4bbb-bd40-d956927edc47 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "DELETE /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9/os-volume_attachments/76f4720e-f95f-496f-bcfb-a10bb877190b" status: 202 len: 0 microversion: 2.1 time: 0.191705 Jun 08 02:12:06.766238 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 353/722] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jun 8 02:12:06 2022] DELETE /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9/os-volume_attachments/76f4720e-f95f-496f-bcfb-a10bb877190b => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 02:12:06.877163 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-3cb053f3-9a0f-4498-90fe-1f158e2cc418 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:06.886226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-3cb053f3-9a0f-4498-90fe-1f158e2cc418 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:06.887756 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-3cb053f3-9a0f-4498-90fe-1f158e2cc418 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:06.889095 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-3cb053f3-9a0f-4498-90fe-1f158e2cc418 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1731 microversion: 2.20 time: 0.269497 Jun 08 02:12:06.892682 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 370/723] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:12:06 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1731 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 02:12:07.525208 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7eb9f4fc-c743-40c8-92b2-ded16607f364 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:07.527094 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7eb9f4fc-c743-40c8-92b2-ded16607f364 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:07.543198 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7eb9f4fc-c743-40c8-92b2-ded16607f364 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:07.544122 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7eb9f4fc-c743-40c8-92b2-ded16607f364 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:07.545379 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7eb9f4fc-c743-40c8-92b2-ded16607f364 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:07.546667 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7eb9f4fc-c743-40c8-92b2-ded16607f364 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:07.912266 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-fc7c6ab8-d370-4d4d-b53c-8e9f6f59f9d0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:07.915408 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-fc7c6ab8-d370-4d4d-b53c-8e9f6f59f9d0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:07.924146 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7eb9f4fc-c743-40c8-92b2-ded16607f364 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:07.930768 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fc7c6ab8-d370-4d4d-b53c-8e9f6f59f9d0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:07.931557 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fc7c6ab8-d370-4d4d-b53c-8e9f6f59f9d0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:07.932562 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fc7c6ab8-d370-4d4d-b53c-8e9f6f59f9d0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:07.933156 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fc7c6ab8-d370-4d4d-b53c-8e9f6f59f9d0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:07.941659 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7eb9f4fc-c743-40c8-92b2-ded16607f364 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1359 microversion: 2.1 time: 0.421882 Jun 08 02:12:07.946311 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 354/724] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:12:07 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1359 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:12:08.104423 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-fc7c6ab8-d370-4d4d-b53c-8e9f6f59f9d0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:08.113756 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-fc7c6ab8-d370-4d4d-b53c-8e9f6f59f9d0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:08.115664 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-fc7c6ab8-d370-4d4d-b53c-8e9f6f59f9d0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:08.118250 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-fc7c6ab8-d370-4d4d-b53c-8e9f6f59f9d0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1731 microversion: 2.20 time: 0.210840 Jun 08 02:12:08.119949 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 371/725] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:12:07 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1731 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:12:08.966692 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-bfd37eaa-9c39-4aa7-91be-70c71ee955cd tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:08.967303 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-bfd37eaa-9c39-4aa7-91be-70c71ee955cd tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:08.974798 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bfd37eaa-9c39-4aa7-91be-70c71ee955cd tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:08.975607 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bfd37eaa-9c39-4aa7-91be-70c71ee955cd tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:08.976982 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bfd37eaa-9c39-4aa7-91be-70c71ee955cd tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:08.977596 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bfd37eaa-9c39-4aa7-91be-70c71ee955cd tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:09.146403 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2968be0f-b196-4667-9faa-b5d8af5ede11 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:09.148126 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-2968be0f-b196-4667-9faa-b5d8af5ede11 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:09.149815 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-bfd37eaa-9c39-4aa7-91be-70c71ee955cd tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:09.158052 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2968be0f-b196-4667-9faa-b5d8af5ede11 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:09.158685 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2968be0f-b196-4667-9faa-b5d8af5ede11 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:09.159098 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-bfd37eaa-9c39-4aa7-91be-70c71ee955cd tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1359 microversion: 2.1 time: 0.200100 Jun 08 02:12:09.159769 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 355/726] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:12:08 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1359 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:12:09.170085 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2968be0f-b196-4667-9faa-b5d8af5ede11 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:09.171094 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2968be0f-b196-4667-9faa-b5d8af5ede11 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:09.317932 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2968be0f-b196-4667-9faa-b5d8af5ede11 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:09.326827 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2968be0f-b196-4667-9faa-b5d8af5ede11 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:09.328339 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2968be0f-b196-4667-9faa-b5d8af5ede11 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:09.329542 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2968be0f-b196-4667-9faa-b5d8af5ede11 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1731 microversion: 2.20 time: 0.194602 Jun 08 02:12:09.330079 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 372/727] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:12:09 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1731 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:12:09.639002 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-7fd08aa4-54af-4599-8782-c43df6e0d4f7 req-e2009dcf-edfe-4e9a-8121-6b199628c50a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19726b62-06f4-4547-9021-b58c9571f183", "name": "network-vif-plugged", "status": "completed", "tag": "92dccdf3-f4c8-42b5-aee4-d2373577dd65"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:12:09.647237 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-7fd08aa4-54af-4599-8782-c43df6e0d4f7 req-e2009dcf-edfe-4e9a-8121-6b199628c50a service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:09.647725 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-7fd08aa4-54af-4599-8782-c43df6e0d4f7 req-e2009dcf-edfe-4e9a-8121-6b199628c50a service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:09.661461 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-7fd08aa4-54af-4599-8782-c43df6e0d4f7 req-e2009dcf-edfe-4e9a-8121-6b199628c50a service nova] Creating event network-vif-plugged:92dccdf3-f4c8-42b5-aee4-d2373577dd65 for instance 19726b62-06f4-4547-9021-b58c9571f183 on hv-cinder-84506 Jun 08 02:12:09.674050 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-7fd08aa4-54af-4599-8782-c43df6e0d4f7 req-e2009dcf-edfe-4e9a-8121-6b199628c50a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038268 Jun 08 02:12:09.675087 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 356/728] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:12:10.176743 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-4f9f9761-c0b9-49a6-8f63-bb6eb5ede2c1 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:10.177370 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-4f9f9761-c0b9-49a6-8f63-bb6eb5ede2c1 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:10.184483 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4f9f9761-c0b9-49a6-8f63-bb6eb5ede2c1 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:10.184926 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4f9f9761-c0b9-49a6-8f63-bb6eb5ede2c1 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:10.185690 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4f9f9761-c0b9-49a6-8f63-bb6eb5ede2c1 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:10.186114 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4f9f9761-c0b9-49a6-8f63-bb6eb5ede2c1 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:10.334989 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-4f9f9761-c0b9-49a6-8f63-bb6eb5ede2c1 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:10.342422 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-4f9f9761-c0b9-49a6-8f63-bb6eb5ede2c1 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1359 microversion: 2.1 time: 0.169678 Jun 08 02:12:10.343236 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 373/729] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:12:10 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:12:10.349170 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9fbcedcb-b814-48d8-918d-ad289b291760 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:10.349990 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9fbcedcb-b814-48d8-918d-ad289b291760 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:10.358839 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9fbcedcb-b814-48d8-918d-ad289b291760 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:10.359294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9fbcedcb-b814-48d8-918d-ad289b291760 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:10.360074 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9fbcedcb-b814-48d8-918d-ad289b291760 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:10.360538 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9fbcedcb-b814-48d8-918d-ad289b291760 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:10.566125 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9fbcedcb-b814-48d8-918d-ad289b291760 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:10.596621 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9fbcedcb-b814-48d8-918d-ad289b291760 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:10.598236 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9fbcedcb-b814-48d8-918d-ad289b291760 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:10.605883 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9fbcedcb-b814-48d8-918d-ad289b291760 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1731 microversion: 2.20 time: 0.261497 Jun 08 02:12:10.606488 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 357/730] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:12:10 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1731 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 02:12:11.359665 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-441df0a8-8474-4ac1-ada3-b6711dc393fa tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:11.360248 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-441df0a8-8474-4ac1-ada3-b6711dc393fa tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:11.367789 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-441df0a8-8474-4ac1-ada3-b6711dc393fa tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:11.368234 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-441df0a8-8474-4ac1-ada3-b6711dc393fa tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:11.369031 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-441df0a8-8474-4ac1-ada3-b6711dc393fa tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:11.369464 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-441df0a8-8474-4ac1-ada3-b6711dc393fa tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:11.511049 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-441df0a8-8474-4ac1-ada3-b6711dc393fa tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:11.519660 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-441df0a8-8474-4ac1-ada3-b6711dc393fa tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1359 microversion: 2.1 time: 0.164107 Jun 08 02:12:11.527604 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 374/731] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:12:11 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:12:11.623600 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-81b870e8-bc77-40f8-b64c-a235f603929e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:11.624193 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-81b870e8-bc77-40f8-b64c-a235f603929e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:11.631086 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-81b870e8-bc77-40f8-b64c-a235f603929e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:11.631533 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-81b870e8-bc77-40f8-b64c-a235f603929e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:11.632941 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-81b870e8-bc77-40f8-b64c-a235f603929e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:11.633382 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-81b870e8-bc77-40f8-b64c-a235f603929e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:11.775954 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-81b870e8-bc77-40f8-b64c-a235f603929e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:11.789040 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-81b870e8-bc77-40f8-b64c-a235f603929e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:11.791792 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-81b870e8-bc77-40f8-b64c-a235f603929e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:11.793033 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-81b870e8-bc77-40f8-b64c-a235f603929e tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1731 microversion: 2.20 time: 0.173392 Jun 08 02:12:11.793686 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 358/732] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:12:11 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:12:12.538731 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-62627194-16f1-45c8-a97b-da6ce2d69f61 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:12.539349 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-62627194-16f1-45c8-a97b-da6ce2d69f61 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:12.546159 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-62627194-16f1-45c8-a97b-da6ce2d69f61 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:12.546622 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-62627194-16f1-45c8-a97b-da6ce2d69f61 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:12.547411 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-62627194-16f1-45c8-a97b-da6ce2d69f61 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:12.548023 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-62627194-16f1-45c8-a97b-da6ce2d69f61 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:12.720688 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-62627194-16f1-45c8-a97b-da6ce2d69f61 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:12.729888 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-62627194-16f1-45c8-a97b-da6ce2d69f61 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1359 microversion: 2.1 time: 0.195320 Jun 08 02:12:12.730875 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 375/733] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:12:12 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:12:12.813082 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5aa2974f-4286-4e2f-824a-0552ea738361 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:12.813670 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5aa2974f-4286-4e2f-824a-0552ea738361 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:12.821076 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5aa2974f-4286-4e2f-824a-0552ea738361 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:12.821651 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5aa2974f-4286-4e2f-824a-0552ea738361 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:12.822585 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5aa2974f-4286-4e2f-824a-0552ea738361 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:12.823017 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5aa2974f-4286-4e2f-824a-0552ea738361 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:12.988794 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5aa2974f-4286-4e2f-824a-0552ea738361 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:13.001629 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5aa2974f-4286-4e2f-824a-0552ea738361 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:13.003669 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5aa2974f-4286-4e2f-824a-0552ea738361 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:13.005001 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5aa2974f-4286-4e2f-824a-0552ea738361 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1731 microversion: 2.20 time: 0.195944 Jun 08 02:12:13.015444 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 359/734] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:12:12 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1731 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:12:13.750726 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0d66a0e9-aadf-45b6-8a19-22b7ab6360f8 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:13.752667 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-0d66a0e9-aadf-45b6-8a19-22b7ab6360f8 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:13.760188 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0d66a0e9-aadf-45b6-8a19-22b7ab6360f8 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:13.761152 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0d66a0e9-aadf-45b6-8a19-22b7ab6360f8 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:13.762405 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0d66a0e9-aadf-45b6-8a19-22b7ab6360f8 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:13.763649 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0d66a0e9-aadf-45b6-8a19-22b7ab6360f8 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:13.910125 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-0d66a0e9-aadf-45b6-8a19-22b7ab6360f8 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:13.919132 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-0d66a0e9-aadf-45b6-8a19-22b7ab6360f8 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1359 microversion: 2.1 time: 0.172236 Jun 08 02:12:13.919708 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 376/735] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:12:13 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:12:14.023679 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-801f6dc9-9278-4f51-b157-da1d05400d84 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:14.024292 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-801f6dc9-9278-4f51-b157-da1d05400d84 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:14.026183 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=4 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:12:14.032302 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-801f6dc9-9278-4f51-b157-da1d05400d84 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:14.033025 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-801f6dc9-9278-4f51-b157-da1d05400d84 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:14.033988 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-801f6dc9-9278-4f51-b157-da1d05400d84 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:14.034423 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-801f6dc9-9278-4f51-b157-da1d05400d84 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:14.186070 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-801f6dc9-9278-4f51-b157-da1d05400d84 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:14.195717 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-801f6dc9-9278-4f51-b157-da1d05400d84 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:14.197658 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-801f6dc9-9278-4f51-b157-da1d05400d84 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:14.199036 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-801f6dc9-9278-4f51-b157-da1d05400d84 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1731 microversion: 2.20 time: 0.179956 Jun 08 02:12:14.199746 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 360/736] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:12:14 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:12:14.935384 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-1c2d36a3-1114-4fc9-8960-3f7bfea2e4b8 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:14.935988 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-1c2d36a3-1114-4fc9-8960-3f7bfea2e4b8 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:14.937830 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=2 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:12:14.938657 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=8 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:12:14.946399 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1c2d36a3-1114-4fc9-8960-3f7bfea2e4b8 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:14.946946 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1c2d36a3-1114-4fc9-8960-3f7bfea2e4b8 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:14.947822 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1c2d36a3-1114-4fc9-8960-3f7bfea2e4b8 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:14.948264 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1c2d36a3-1114-4fc9-8960-3f7bfea2e4b8 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:15.080312 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1c2d36a3-1114-4fc9-8960-3f7bfea2e4b8 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:15.087658 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-1c2d36a3-1114-4fc9-8960-3f7bfea2e4b8 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1359 microversion: 2.1 time: 0.156125 Jun 08 02:12:15.088218 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 377/737] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:12:14 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:12:15.216840 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d99dcc37-782a-4699-9013-7790880711b7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:15.217375 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d99dcc37-782a-4699-9013-7790880711b7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:15.223744 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d99dcc37-782a-4699-9013-7790880711b7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:15.224185 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d99dcc37-782a-4699-9013-7790880711b7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:15.224971 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d99dcc37-782a-4699-9013-7790880711b7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:15.225407 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d99dcc37-782a-4699-9013-7790880711b7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:15.353154 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d99dcc37-782a-4699-9013-7790880711b7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:15.361104 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d99dcc37-782a-4699-9013-7790880711b7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:15.362595 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d99dcc37-782a-4699-9013-7790880711b7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:15.363745 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d99dcc37-782a-4699-9013-7790880711b7 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1731 microversion: 2.20 time: 0.150844 Jun 08 02:12:15.364300 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 361/738] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:12:15 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:12:16.105495 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-9cda5d81-479d-4486-b8cb-92eb9bb4aad8 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:16.106105 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-9cda5d81-479d-4486-b8cb-92eb9bb4aad8 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:16.112737 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9cda5d81-479d-4486-b8cb-92eb9bb4aad8 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:16.113304 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9cda5d81-479d-4486-b8cb-92eb9bb4aad8 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:16.114065 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9cda5d81-479d-4486-b8cb-92eb9bb4aad8 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:16.114494 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9cda5d81-479d-4486-b8cb-92eb9bb4aad8 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:16.188139 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-668568b9-9745-4de2-9ace-031e52d85466 req-b50043c5-28c4-43ab-9545-651bd25ce597 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b532af5d-7b14-4644-add7-8b716f81871f", "tag": "906aaccc-01a6-40cf-a960-5f798d175167"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:12:16.202295 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-668568b9-9745-4de2-9ace-031e52d85466 req-b50043c5-28c4-43ab-9545-651bd25ce597 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:16.202749 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-668568b9-9745-4de2-9ace-031e52d85466 req-b50043c5-28c4-43ab-9545-651bd25ce597 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:16.219291 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-668568b9-9745-4de2-9ace-031e52d85466 req-b50043c5-28c4-43ab-9545-651bd25ce597 service nova] Creating event network-changed:906aaccc-01a6-40cf-a960-5f798d175167 for instance b532af5d-7b14-4644-add7-8b716f81871f on hv-cinder-84506 Jun 08 02:12:16.229200 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-668568b9-9745-4de2-9ace-031e52d85466 req-b50043c5-28c4-43ab-9545-651bd25ce597 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043622 Jun 08 02:12:16.230113 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 362/739] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 02:12:16.338877 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-9cda5d81-479d-4486-b8cb-92eb9bb4aad8 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:16.346682 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-9cda5d81-479d-4486-b8cb-92eb9bb4aad8 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1359 microversion: 2.1 time: 0.246025 Jun 08 02:12:16.347450 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 378/740] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:12:16 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1359 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:12:16.383194 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-04421960-4aff-40fa-aaf6-eb2106f378fc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:16.384193 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-04421960-4aff-40fa-aaf6-eb2106f378fc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:16.390745 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-04421960-4aff-40fa-aaf6-eb2106f378fc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:16.391271 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-04421960-4aff-40fa-aaf6-eb2106f378fc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:16.392101 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-04421960-4aff-40fa-aaf6-eb2106f378fc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:16.392632 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-04421960-4aff-40fa-aaf6-eb2106f378fc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:16.430202 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f64987ed-cff4-491c-8291-628057ccc7c8 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:16.430714 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f64987ed-cff4-491c-8291-628057ccc7c8 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: 111070da-9d8e-487a-8e32-60e64894d5a9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:16.436992 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f64987ed-cff4-491c-8291-628057ccc7c8 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:16.437521 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f64987ed-cff4-491c-8291-628057ccc7c8 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:16.438375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f64987ed-cff4-491c-8291-628057ccc7c8 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:16.438824 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f64987ed-cff4-491c-8291-628057ccc7c8 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:16.468055 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f64987ed-cff4-491c-8291-628057ccc7c8 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9/os-volume_attachments/c7893e98-04db-4d64-90c1-4a89a9e19ec9" status: 200 len: 194 microversion: 2.1 time: 0.042006 Jun 08 02:12:16.468869 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 379/741] 10.222.0.20 () {58 vars in 1412 bytes} [Wed Jun 8 02:12:16 2022] GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9/os-volume_attachments/c7893e98-04db-4d64-90c1-4a89a9e19ec9 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 02:12:16.479483 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-804c8ead-ce1d-450e-a3d1-23e826c3924c tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:16.479982 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-804c8ead-ce1d-450e-a3d1-23e826c3924c tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: 111070da-9d8e-487a-8e32-60e64894d5a9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:16.486429 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-804c8ead-ce1d-450e-a3d1-23e826c3924c tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:16.486877 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-804c8ead-ce1d-450e-a3d1-23e826c3924c tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:16.487653 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-804c8ead-ce1d-450e-a3d1-23e826c3924c tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:16.488098 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-804c8ead-ce1d-450e-a3d1-23e826c3924c tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:16.573355 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.objects.instance [None req-804c8ead-ce1d-450e-a3d1-23e826c3924c tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lazy-loading 'services' on Instance uuid 111070da-9d8e-487a-8e32-60e64894d5a9 {{(pid=117939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 02:12:16.600601 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-04421960-4aff-40fa-aaf6-eb2106f378fc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:16.611240 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-04421960-4aff-40fa-aaf6-eb2106f378fc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:16.614252 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-04421960-4aff-40fa-aaf6-eb2106f378fc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:16.615554 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-04421960-4aff-40fa-aaf6-eb2106f378fc tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1731 microversion: 2.20 time: 0.236979 Jun 08 02:12:16.616487 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 363/742] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:12:16 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1731 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:12:16.648757 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-804c8ead-ce1d-450e-a3d1-23e826c3924c tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "DELETE /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9/os-volume_attachments/c7893e98-04db-4d64-90c1-4a89a9e19ec9" status: 202 len: 0 microversion: 2.1 time: 0.173450 Jun 08 02:12:16.649342 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 380/743] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jun 8 02:12:16 2022] DELETE /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9/os-volume_attachments/c7893e98-04db-4d64-90c1-4a89a9e19ec9 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 08 02:12:17.364103 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d72743ff-4051-43b9-87e4-970d40703e79 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:17.364736 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d72743ff-4051-43b9-87e4-970d40703e79 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:17.371803 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d72743ff-4051-43b9-87e4-970d40703e79 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:17.372258 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d72743ff-4051-43b9-87e4-970d40703e79 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:17.373149 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d72743ff-4051-43b9-87e4-970d40703e79 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:17.373591 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d72743ff-4051-43b9-87e4-970d40703e79 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:17.554338 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d72743ff-4051-43b9-87e4-970d40703e79 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:17.562476 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d72743ff-4051-43b9-87e4-970d40703e79 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1359 microversion: 2.1 time: 0.202214 Jun 08 02:12:17.563032 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 364/744] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:12:17 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1359 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:12:17.636315 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-cd23f76b-277f-4e88-9318-32cb0b9084a2 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:17.637108 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-cd23f76b-277f-4e88-9318-32cb0b9084a2 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:17.643584 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cd23f76b-277f-4e88-9318-32cb0b9084a2 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:17.644027 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cd23f76b-277f-4e88-9318-32cb0b9084a2 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:17.644989 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cd23f76b-277f-4e88-9318-32cb0b9084a2 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:17.645418 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cd23f76b-277f-4e88-9318-32cb0b9084a2 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:17.941565 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-cd23f76b-277f-4e88-9318-32cb0b9084a2 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:17.949369 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-cd23f76b-277f-4e88-9318-32cb0b9084a2 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:17.950874 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-cd23f76b-277f-4e88-9318-32cb0b9084a2 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:17.952016 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-cd23f76b-277f-4e88-9318-32cb0b9084a2 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1731 microversion: 2.20 time: 0.321257 Jun 08 02:12:17.952589 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 381/745] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:12:17 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1731 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:12:18.579056 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5a1dc67f-9dd5-49c7-a93b-639057eb1336 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:18.579663 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5a1dc67f-9dd5-49c7-a93b-639057eb1336 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:18.586802 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5a1dc67f-9dd5-49c7-a93b-639057eb1336 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:18.587337 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5a1dc67f-9dd5-49c7-a93b-639057eb1336 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:18.588088 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5a1dc67f-9dd5-49c7-a93b-639057eb1336 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:18.588558 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5a1dc67f-9dd5-49c7-a93b-639057eb1336 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:18.717504 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5a1dc67f-9dd5-49c7-a93b-639057eb1336 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:18.724854 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5a1dc67f-9dd5-49c7-a93b-639057eb1336 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1359 microversion: 2.1 time: 0.149591 Jun 08 02:12:18.725400 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 365/746] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:12:18 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:12:18.969094 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ac469304-de5b-4734-8da2-a34e372b8dce tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:18.969698 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ac469304-de5b-4734-8da2-a34e372b8dce tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:18.976004 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ac469304-de5b-4734-8da2-a34e372b8dce tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:18.976671 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ac469304-de5b-4734-8da2-a34e372b8dce tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:18.977532 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ac469304-de5b-4734-8da2-a34e372b8dce tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:18.977959 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ac469304-de5b-4734-8da2-a34e372b8dce tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:18.982091 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:12:19.181225 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ac469304-de5b-4734-8da2-a34e372b8dce tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:19.190170 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ac469304-de5b-4734-8da2-a34e372b8dce tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:19.191659 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ac469304-de5b-4734-8da2-a34e372b8dce tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:19.193275 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ac469304-de5b-4734-8da2-a34e372b8dce tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1718 microversion: 2.20 time: 0.227909 Jun 08 02:12:19.193814 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 382/747] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:12:18 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1718 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:12:19.741782 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-be27fd75-2045-4db5-b25e-98acd5b2912b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:19.743227 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-be27fd75-2045-4db5-b25e-98acd5b2912b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:19.749803 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-be27fd75-2045-4db5-b25e-98acd5b2912b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:19.750239 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-be27fd75-2045-4db5-b25e-98acd5b2912b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:19.750985 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-be27fd75-2045-4db5-b25e-98acd5b2912b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:19.751414 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-be27fd75-2045-4db5-b25e-98acd5b2912b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:19.755453 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:12:19.881932 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-be27fd75-2045-4db5-b25e-98acd5b2912b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:19.889838 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-be27fd75-2045-4db5-b25e-98acd5b2912b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1359 microversion: 2.1 time: 0.151809 Jun 08 02:12:19.890477 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 366/748] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:12:19 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:12:19.936772 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-72c26d37-353c-47bf-82d2-c96c7faa20b8 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:19.937775 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-72c26d37-353c-47bf-82d2-c96c7faa20b8 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: 111070da-9d8e-487a-8e32-60e64894d5a9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:19.943813 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-72c26d37-353c-47bf-82d2-c96c7faa20b8 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:19.944257 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-72c26d37-353c-47bf-82d2-c96c7faa20b8 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:19.945039 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-72c26d37-353c-47bf-82d2-c96c7faa20b8 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:19.945472 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-72c26d37-353c-47bf-82d2-c96c7faa20b8 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:19.972302 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-72c26d37-353c-47bf-82d2-c96c7faa20b8 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.039493 Jun 08 02:12:19.972951 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 383/749] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jun 8 02:12:19 2022] GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 08 02:12:20.076707 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c90811c4-3f46-424e-a9a8-5506bb48b41a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:20.077624 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c90811c4-3f46-424e-a9a8-5506bb48b41a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: 111070da-9d8e-487a-8e32-60e64894d5a9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:20.083519 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c90811c4-3f46-424e-a9a8-5506bb48b41a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:20.083968 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c90811c4-3f46-424e-a9a8-5506bb48b41a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:20.084761 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c90811c4-3f46-424e-a9a8-5506bb48b41a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:20.085196 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c90811c4-3f46-424e-a9a8-5506bb48b41a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:20.113736 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c90811c4-3f46-424e-a9a8-5506bb48b41a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040988 Jun 08 02:12:20.114278 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 367/750] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jun 8 02:12:20 2022] GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 08 02:12:20.171135 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e60d3f21-7bbe-4eee-aa13-71096d0812fb tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:20.171629 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e60d3f21-7bbe-4eee-aa13-71096d0812fb tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: 111070da-9d8e-487a-8e32-60e64894d5a9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:20.178017 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e60d3f21-7bbe-4eee-aa13-71096d0812fb tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:20.178457 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e60d3f21-7bbe-4eee-aa13-71096d0812fb tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:20.179212 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e60d3f21-7bbe-4eee-aa13-71096d0812fb tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:20.179675 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e60d3f21-7bbe-4eee-aa13-71096d0812fb tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:20.204553 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e60d3f21-7bbe-4eee-aa13-71096d0812fb tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: 111070da-9d8e-487a-8e32-60e64894d5a9] Going to try to terminate instance {{(pid=117939) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 02:12:20.283161 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e60d3f21-7bbe-4eee-aa13-71096d0812fb tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "DELETE /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9" status: 204 len: 0 microversion: 2.1 time: 0.115315 Jun 08 02:12:20.283649 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 384/751] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jun 8 02:12:20 2022] DELETE /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 08 02:12:20.293270 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-57e93e7a-b805-41c2-8f68-b1a67a62b42b tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:20.293882 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-57e93e7a-b805-41c2-8f68-b1a67a62b42b tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: 111070da-9d8e-487a-8e32-60e64894d5a9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:20.299926 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-57e93e7a-b805-41c2-8f68-b1a67a62b42b tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:20.300382 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-57e93e7a-b805-41c2-8f68-b1a67a62b42b tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:20.301175 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-57e93e7a-b805-41c2-8f68-b1a67a62b42b tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:20.301610 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-57e93e7a-b805-41c2-8f68-b1a67a62b42b tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:20.430349 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-57e93e7a-b805-41c2-8f68-b1a67a62b42b tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:20.437761 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-57e93e7a-b805-41c2-8f68-b1a67a62b42b tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9" status: 200 len: 1675 microversion: 2.1 time: 0.149661 Jun 08 02:12:20.438328 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 368/752] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:12:20 2022] GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:12:20.907096 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2921ac8b-ccdc-449a-a356-2e4c7a129034 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:20.907818 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-2921ac8b-ccdc-449a-a356-2e4c7a129034 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:20.915011 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2921ac8b-ccdc-449a-a356-2e4c7a129034 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:20.915299 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2921ac8b-ccdc-449a-a356-2e4c7a129034 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:20.916216 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2921ac8b-ccdc-449a-a356-2e4c7a129034 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:20.916678 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2921ac8b-ccdc-449a-a356-2e4c7a129034 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:21.043686 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2921ac8b-ccdc-449a-a356-2e4c7a129034 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:21.051198 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2921ac8b-ccdc-449a-a356-2e4c7a129034 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1359 microversion: 2.1 time: 0.148302 Jun 08 02:12:21.051753 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 385/753] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:12:20 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:12:21.455133 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3415e353-4244-473b-8461-08bcfee1aca2 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:21.455668 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3415e353-4244-473b-8461-08bcfee1aca2 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: 111070da-9d8e-487a-8e32-60e64894d5a9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:21.462320 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3415e353-4244-473b-8461-08bcfee1aca2 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:21.462765 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3415e353-4244-473b-8461-08bcfee1aca2 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:21.463529 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3415e353-4244-473b-8461-08bcfee1aca2 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:21.463963 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3415e353-4244-473b-8461-08bcfee1aca2 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:21.591492 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3415e353-4244-473b-8461-08bcfee1aca2 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:21.598906 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3415e353-4244-473b-8461-08bcfee1aca2 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9" status: 200 len: 1675 microversion: 2.1 time: 0.147757 Jun 08 02:12:21.599464 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 369/754] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:12:21 2022] GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9 => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:12:22.069325 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a5915bf7-57bc-4c4c-b6e7-cd3eee09eca6 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:22.070132 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a5915bf7-57bc-4c4c-b6e7-cd3eee09eca6 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:22.076669 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a5915bf7-57bc-4c4c-b6e7-cd3eee09eca6 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:22.077118 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a5915bf7-57bc-4c4c-b6e7-cd3eee09eca6 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:22.077881 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a5915bf7-57bc-4c4c-b6e7-cd3eee09eca6 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:22.078315 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a5915bf7-57bc-4c4c-b6e7-cd3eee09eca6 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:22.248974 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a5915bf7-57bc-4c4c-b6e7-cd3eee09eca6 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:22.258409 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a5915bf7-57bc-4c4c-b6e7-cd3eee09eca6 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1359 microversion: 2.1 time: 0.192964 Jun 08 02:12:22.260682 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 386/755] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:12:22 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:12:22.616636 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-895257b3-9bf2-4500-b2a3-23e5ab3b9e1f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:22.617742 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-895257b3-9bf2-4500-b2a3-23e5ab3b9e1f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: 111070da-9d8e-487a-8e32-60e64894d5a9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:22.624205 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-895257b3-9bf2-4500-b2a3-23e5ab3b9e1f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:22.624682 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-895257b3-9bf2-4500-b2a3-23e5ab3b9e1f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:22.625449 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-895257b3-9bf2-4500-b2a3-23e5ab3b9e1f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:22.625881 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-895257b3-9bf2-4500-b2a3-23e5ab3b9e1f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:22.868966 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-895257b3-9bf2-4500-b2a3-23e5ab3b9e1f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:22.880826 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-895257b3-9bf2-4500-b2a3-23e5ab3b9e1f tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9" status: 200 len: 1675 microversion: 2.1 time: 0.266201 Jun 08 02:12:22.891028 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 370/756] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:12:22 2022] GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9 => generated 1675 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:12:23.275480 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-5462ed96-8ea3-44cd-86f0-df5f58268282 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:23.276089 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-5462ed96-8ea3-44cd-86f0-df5f58268282 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:23.282815 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5462ed96-8ea3-44cd-86f0-df5f58268282 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:23.283512 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5462ed96-8ea3-44cd-86f0-df5f58268282 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:23.284285 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5462ed96-8ea3-44cd-86f0-df5f58268282 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:23.284742 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5462ed96-8ea3-44cd-86f0-df5f58268282 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:23.392541 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-e094e617-349d-4b65-8abe-798be8c99ac5 req-95d4ea90-6afb-4115-93ae-43abde821214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "111070da-9d8e-487a-8e32-60e64894d5a9", "name": "network-vif-deleted", "tag": "a08f634a-054d-4449-a583-749597fcedc6"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:12:23.403994 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-e094e617-349d-4b65-8abe-798be8c99ac5 req-95d4ea90-6afb-4115-93ae-43abde821214 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:23.404842 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-e094e617-349d-4b65-8abe-798be8c99ac5 req-95d4ea90-6afb-4115-93ae-43abde821214 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:23.417717 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-e094e617-349d-4b65-8abe-798be8c99ac5 req-95d4ea90-6afb-4115-93ae-43abde821214 service nova] Creating event network-vif-deleted:a08f634a-054d-4449-a583-749597fcedc6 for instance 111070da-9d8e-487a-8e32-60e64894d5a9 on hv-cinder-84506 Jun 08 02:12:23.423493 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-e094e617-349d-4b65-8abe-798be8c99ac5 req-95d4ea90-6afb-4115-93ae-43abde821214 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035135 Jun 08 02:12:23.424271 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 371/757] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:12:23.471940 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-5462ed96-8ea3-44cd-86f0-df5f58268282 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:23.481039 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-5462ed96-8ea3-44cd-86f0-df5f58268282 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1359 microversion: 2.1 time: 0.209702 Jun 08 02:12:23.481761 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 387/758] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:12:23 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1359 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:12:23.645862 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-b209cc55-61ea-4499-9884-b8be181a59d0 req-566d7711-5d58-4ef6-82a2-4fa9e70d6c73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b532af5d-7b14-4644-add7-8b716f81871f", "name": "network-vif-plugged", "status": "completed", "tag": "906aaccc-01a6-40cf-a960-5f798d175167"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:12:23.656094 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-b209cc55-61ea-4499-9884-b8be181a59d0 req-566d7711-5d58-4ef6-82a2-4fa9e70d6c73 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:23.656674 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-b209cc55-61ea-4499-9884-b8be181a59d0 req-566d7711-5d58-4ef6-82a2-4fa9e70d6c73 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:23.669209 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-b209cc55-61ea-4499-9884-b8be181a59d0 req-566d7711-5d58-4ef6-82a2-4fa9e70d6c73 service nova] Creating event network-vif-plugged:906aaccc-01a6-40cf-a960-5f798d175167 for instance b532af5d-7b14-4644-add7-8b716f81871f on hv-cinder-84506 Jun 08 02:12:23.674273 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-b209cc55-61ea-4499-9884-b8be181a59d0 req-566d7711-5d58-4ef6-82a2-4fa9e70d6c73 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032959 Jun 08 02:12:23.675261 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 372/759] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:12:23.901915 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a4623711-1785-4f7e-85df-f9339014e5ac tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:23.902911 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a4623711-1785-4f7e-85df-f9339014e5ac tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: 111070da-9d8e-487a-8e32-60e64894d5a9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:23.915946 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a4623711-1785-4f7e-85df-f9339014e5ac tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:23.916424 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a4623711-1785-4f7e-85df-f9339014e5ac tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:23.917205 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a4623711-1785-4f7e-85df-f9339014e5ac tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:23.927323 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a4623711-1785-4f7e-85df-f9339014e5ac tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:23.964682 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a4623711-1785-4f7e-85df-f9339014e5ac tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:23.964901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a4623711-1785-4f7e-85df-f9339014e5ac tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:23.965213 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.objects.instance [None req-a4623711-1785-4f7e-85df-f9339014e5ac tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lazy-loading 'fault' on Instance uuid 111070da-9d8e-487a-8e32-60e64894d5a9 {{(pid=117939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 02:12:24.013576 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a4623711-1785-4f7e-85df-f9339014e5ac tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b43d2b8b9084099b832332a565e741c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f98152ab3440cf824c9ceb1c790bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:24.020577 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a4623711-1785-4f7e-85df-f9339014e5ac tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9" status: 200 len: 1327 microversion: 2.1 time: 0.125570 Jun 08 02:12:24.021396 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 388/760] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:12:23 2022] GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9 => generated 1327 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:12:24.498484 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b0ccd5bf-5aca-4670-baff-d09d7e94818d tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:24.499175 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b0ccd5bf-5aca-4670-baff-d09d7e94818d tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:24.505482 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b0ccd5bf-5aca-4670-baff-d09d7e94818d tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:24.505924 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b0ccd5bf-5aca-4670-baff-d09d7e94818d tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:24.506672 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b0ccd5bf-5aca-4670-baff-d09d7e94818d tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:24.507103 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b0ccd5bf-5aca-4670-baff-d09d7e94818d tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:24.645661 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b0ccd5bf-5aca-4670-baff-d09d7e94818d tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:24.653070 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b0ccd5bf-5aca-4670-baff-d09d7e94818d tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1359 microversion: 2.1 time: 0.158925 Jun 08 02:12:24.653659 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 373/761] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:12:24 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:12:25.038677 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-057fc75d-9cad-4147-81cf-474f9c1c074e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:25.040200 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-057fc75d-9cad-4147-81cf-474f9c1c074e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: 111070da-9d8e-487a-8e32-60e64894d5a9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:25.042765 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:12:25.048053 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-057fc75d-9cad-4147-81cf-474f9c1c074e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:25.048539 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-057fc75d-9cad-4147-81cf-474f9c1c074e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:25.049298 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-057fc75d-9cad-4147-81cf-474f9c1c074e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:25.049732 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-057fc75d-9cad-4147-81cf-474f9c1c074e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:25.064256 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-057fc75d-9cad-4147-81cf-474f9c1c074e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] HTTP exception thrown: Instance 111070da-9d8e-487a-8e32-60e64894d5a9 could not be found. Jun 08 02:12:25.065882 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-057fc75d-9cad-4147-81cf-474f9c1c074e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Request method failure captured: Jun 08 02:12:25.065882 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9 HTTP/1.1 Jun 08 02:12:25.065882 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept: application/json Jun 08 02:12:25.065882 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jun 08 02:12:25.065882 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Connection: close Jun 08 02:12:25.065882 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jun 08 02:12:25.065882 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jun 08 02:12:25.065882 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Host: 10.222.0.20 Jun 08 02:12:25.065882 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jun 08 02:12:25.065882 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jun 08 02:12:25.065882 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABioAPruCb3ZyVjnBR9xX7jet-ghimTaVPiZeXdjX5RQP3HgkXpFkIFH5N8xgnWqRgsT6I2aqtXziMXFjRQ81Zxa0cQ3vkw8PhQlhyPdcAGwi5zmqH8qiWuC3J9KnW7yZD82jUljPEBc5VOaH4zABHhrL0GaEIkKthfPNB-DUtnqK3CO9I Jun 08 02:12:25.065882 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jun 08 02:12:25.065882 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jun 08 02:12:25.065882 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jun 08 02:12:25.065882 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jun 08 02:12:25.065882 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jun 08 02:12:25.065882 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jun 08 02:12:25.065882 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Id: 27f98152ab3440cf824c9ceb1c790bcf Jun 08 02:12:25.065882 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-AttachVolumeTestJSON-1681895122 Jun 08 02:12:25.065882 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jun 08 02:12:25.065882 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jun 08 02:12:25.067471 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27f98152ab3440cf824c9ceb1c790bcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27f98152ab3440cf824c9ceb1c790bcf", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27f98152ab3440cf824c9ceb1c790bcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27f98152ab3440cf824c9ceb1c790bcf"}]}] Jun 08 02:12:25.067471 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-AttachVolumeTestJSON-1681895122 Jun 08 02:12:25.067471 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 27f98152ab3440cf824c9ceb1c790bcf Jun 08 02:12:25.067471 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1681895122 Jun 08 02:12:25.067471 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User: tempest-AttachVolumeTestJSON-1681895122-project Jun 08 02:12:25.067471 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jun 08 02:12:25.067471 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jun 08 02:12:25.067471 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Id: 1b43d2b8b9084099b832332a565e741c Jun 08 02:12:25.067471 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-AttachVolumeTestJSON-1681895122-project Jun 08 02:12:25.067471 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: method: > Jun 08 02:12:25.067471 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: exception: Instance 111070da-9d8e-487a-8e32-60e64894d5a9 could not be found. Jun 08 02:12:25.067471 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: action_args: {'id': '111070da-9d8e-487a-8e32-60e64894d5a9'} Jun 08 02:12:25.068670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:12:25.068670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:12:25.068670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:12:25.068670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:12:25.068670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:12:25.068670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:12:25.068670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:12:25.068670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:12:25.068670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:12:25.068670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:12:25.068670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 111070da-9d8e-487a-8e32-60e64894d5a9 could not be found. Jun 08 02:12:25.068670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:12:25.068670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:12:25.068670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:12:25.068670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:12:25.068670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:12:25.068670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:12:25.068670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:12:25.068670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:12:25.068670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:12:25.070256 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:12:25.070256 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 02:12:25.070256 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 02:12:25.070256 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:12:25.070256 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:12:25.070256 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:12:25.070256 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:12:25.070256 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 111070da-9d8e-487a-8e32-60e64894d5a9 could not be found. Jun 08 02:12:25.070256 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:12:25.070256 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:12:25.070256 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:12:25.070256 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:12:25.070256 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:12:25.070256 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:12:25.070256 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:12:25.070256 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:12:25.070256 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 111070da-9d8e-487a-8e32-60e64894d5a9 could not be found. Jun 08 02:12:25.070256 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:12:25.071826 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-057fc75d-9cad-4147-81cf-474f9c1c074e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Returning 404 to user: Instance 111070da-9d8e-487a-8e32-60e64894d5a9 could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:12:25.071826 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-057fc75d-9cad-4147-81cf-474f9c1c074e tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9" status: 404 len: 111 microversion: 2.1 time: 0.032625 Jun 08 02:12:25.071826 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 389/762] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:12:25 2022] GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 02:12:25.076208 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e5517352-7140-4636-b1f6-c688f9a725df tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '.version_select at 0x7f8370068550>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:25.093974 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e5517352-7140-4636-b1f6-c688f9a725df tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-126195227" status: 202 len: 0 microversion: 2.1 time: 0.021519 Jun 08 02:12:25.094515 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 374/763] 10.222.0.20 () {58 vars in 1217 bytes} [Wed Jun 8 02:12:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-126195227 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 02:12:25.670741 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-397a6781-e84a-4498-ad89-071a7911d76b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:25.671351 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-397a6781-e84a-4498-ad89-071a7911d76b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:25.677458 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-397a6781-e84a-4498-ad89-071a7911d76b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:25.677901 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-397a6781-e84a-4498-ad89-071a7911d76b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:25.678705 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-397a6781-e84a-4498-ad89-071a7911d76b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:25.679135 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-397a6781-e84a-4498-ad89-071a7911d76b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:25.818385 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-397a6781-e84a-4498-ad89-071a7911d76b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:25.826297 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-397a6781-e84a-4498-ad89-071a7911d76b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1549 microversion: 2.1 time: 0.159541 Jun 08 02:12:25.826858 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 390/764] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:12:25 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:12:25.846712 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1a081f6f-dae3-4e94-bf6a-44e343c6c49a tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:25.847417 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-1a081f6f-dae3-4e94-bf6a-44e343c6c49a tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:25.854350 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1a081f6f-dae3-4e94-bf6a-44e343c6c49a tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:25.854789 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1a081f6f-dae3-4e94-bf6a-44e343c6c49a tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:25.855540 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1a081f6f-dae3-4e94-bf6a-44e343c6c49a tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:25.855969 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1a081f6f-dae3-4e94-bf6a-44e343c6c49a tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:25.987471 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-1a081f6f-dae3-4e94-bf6a-44e343c6c49a tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:25.996601 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1a081f6f-dae3-4e94-bf6a-44e343c6c49a tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1549 microversion: 2.1 time: 0.154113 Jun 08 02:12:25.997288 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 375/765] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:12:25 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:12:26.013148 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-893b5985-6cd0-4c25-b342-145f0c4b1aa3 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:26.016808 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-893b5985-6cd0-4c25-b342-145f0c4b1aa3 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:26.017645 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-893b5985-6cd0-4c25-b342-145f0c4b1aa3 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Searching by: {'deleted': False, 'project_id': '3b0724451ec94fdbb4f2422c44245b53'} {{(pid=117939) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 08 02:12:26.025113 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-893b5985-6cd0-4c25-b342-145f0c4b1aa3 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:26.025561 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-893b5985-6cd0-4c25-b342-145f0c4b1aa3 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:26.026355 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-893b5985-6cd0-4c25-b342-145f0c4b1aa3 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:26.026792 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-893b5985-6cd0-4c25-b342-145f0c4b1aa3 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:26.113456 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.multi_cell_list [None req-893b5985-6cd0-4c25-b342-145f0c4b1aa3 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117939) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 08 02:12:26.206275 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-893b5985-6cd0-4c25-b342-145f0c4b1aa3 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.196849 Jun 08 02:12:26.206762 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 391/766] 10.222.0.20 () {58 vars in 1124 bytes} [Wed Jun 8 02:12:26 2022] GET /compute/v2.1/servers => generated 343 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:12:26.217421 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1fcdd779-cf75-4c42-acad-e2211fb3653c tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:26.218034 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-1fcdd779-cf75-4c42-acad-e2211fb3653c tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:26.219967 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:12:26.225241 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1fcdd779-cf75-4c42-acad-e2211fb3653c tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:26.225685 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1fcdd779-cf75-4c42-acad-e2211fb3653c tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:26.226444 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1fcdd779-cf75-4c42-acad-e2211fb3653c tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:26.226881 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1fcdd779-cf75-4c42-acad-e2211fb3653c tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:26.358848 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-1fcdd779-cf75-4c42-acad-e2211fb3653c tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:26.366335 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1fcdd779-cf75-4c42-acad-e2211fb3653c tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1549 microversion: 2.1 time: 0.152715 Jun 08 02:12:26.367425 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 376/767] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:12:26 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:12:27.896166 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b5715f2c-3840-4f74-946f-8275197c1a42 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce3193f2-8611-429c-82ea-7c9e9d401991"}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:12:27.897363 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-b5715f2c-3840-4f74-946f-8275197c1a42 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:27.904906 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b5715f2c-3840-4f74-946f-8275197c1a42 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:27.905355 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b5715f2c-3840-4f74-946f-8275197c1a42 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:27.906125 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b5715f2c-3840-4f74-946f-8275197c1a42 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:27.906557 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b5715f2c-3840-4f74-946f-8275197c1a42 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:27.981913 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9ffb9308-f019-4e6a-97e6-6c5f98a35a80 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:27.982429 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9ffb9308-f019-4e6a-97e6-6c5f98a35a80 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: 111070da-9d8e-487a-8e32-60e64894d5a9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:27.988911 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9ffb9308-f019-4e6a-97e6-6c5f98a35a80 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:27.989358 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9ffb9308-f019-4e6a-97e6-6c5f98a35a80 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:27.990146 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9ffb9308-f019-4e6a-97e6-6c5f98a35a80 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:27.990580 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9ffb9308-f019-4e6a-97e6-6c5f98a35a80 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:28.004188 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-9ffb9308-f019-4e6a-97e6-6c5f98a35a80 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] HTTP exception thrown: Instance 111070da-9d8e-487a-8e32-60e64894d5a9 could not be found. Jun 08 02:12:28.005862 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9ffb9308-f019-4e6a-97e6-6c5f98a35a80 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Request method failure captured: Jun 08 02:12:28.005862 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: request: DELETE /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9 HTTP/1.1 Jun 08 02:12:28.005862 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept: application/json Jun 08 02:12:28.005862 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jun 08 02:12:28.005862 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Connection: close Jun 08 02:12:28.005862 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jun 08 02:12:28.005862 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jun 08 02:12:28.005862 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Host: 10.222.0.20 Jun 08 02:12:28.005862 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jun 08 02:12:28.005862 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jun 08 02:12:28.005862 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABioAPruCb3ZyVjnBR9xX7jet-ghimTaVPiZeXdjX5RQP3HgkXpFkIFH5N8xgnWqRgsT6I2aqtXziMXFjRQ81Zxa0cQ3vkw8PhQlhyPdcAGwi5zmqH8qiWuC3J9KnW7yZD82jUljPEBc5VOaH4zABHhrL0GaEIkKthfPNB-DUtnqK3CO9I Jun 08 02:12:28.005862 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jun 08 02:12:28.005862 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jun 08 02:12:28.005862 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jun 08 02:12:28.005862 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jun 08 02:12:28.005862 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jun 08 02:12:28.005862 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jun 08 02:12:28.005862 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Id: 27f98152ab3440cf824c9ceb1c790bcf Jun 08 02:12:28.005862 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeTestJSON-1681895122 Jun 08 02:12:28.005862 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jun 08 02:12:28.005862 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jun 08 02:12:28.007341 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27f98152ab3440cf824c9ceb1c790bcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27f98152ab3440cf824c9ceb1c790bcf", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27f98152ab3440cf824c9ceb1c790bcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27f98152ab3440cf824c9ceb1c790bcf"}]}] Jun 08 02:12:28.007341 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeTestJSON-1681895122 Jun 08 02:12:28.007341 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 27f98152ab3440cf824c9ceb1c790bcf Jun 08 02:12:28.007341 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1681895122 Jun 08 02:12:28.007341 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeTestJSON-1681895122-project Jun 08 02:12:28.007341 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jun 08 02:12:28.007341 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jun 08 02:12:28.007341 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Id: 1b43d2b8b9084099b832332a565e741c Jun 08 02:12:28.007341 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeTestJSON-1681895122-project Jun 08 02:12:28.007341 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: method: > Jun 08 02:12:28.007341 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: exception: Instance 111070da-9d8e-487a-8e32-60e64894d5a9 could not be found. Jun 08 02:12:28.007341 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: action_args: {'id': '111070da-9d8e-487a-8e32-60e64894d5a9'} Jun 08 02:12:28.008992 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:12:28.008992 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:12:28.008992 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:12:28.008992 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:12:28.008992 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:12:28.008992 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:12:28.008992 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:12:28.008992 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:12:28.008992 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:12:28.008992 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:12:28.008992 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 111070da-9d8e-487a-8e32-60e64894d5a9 could not be found. Jun 08 02:12:28.008992 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:12:28.008992 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:12:28.008992 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:12:28.008992 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:12:28.008992 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:12:28.008992 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:12:28.008992 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:12:28.008992 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:12:28.008992 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:12:28.010389 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:12:28.010389 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 08 02:12:28.010389 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 08 02:12:28.010389 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 08 02:12:28.010389 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 08 02:12:28.010389 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:12:28.010389 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:12:28.010389 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:12:28.010389 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:12:28.010389 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 111070da-9d8e-487a-8e32-60e64894d5a9 could not be found. Jun 08 02:12:28.010389 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:12:28.010389 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:12:28.010389 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:12:28.010389 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:12:28.010389 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:12:28.010389 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:12:28.010389 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:12:28.010389 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:12:28.010389 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 111070da-9d8e-487a-8e32-60e64894d5a9 could not be found. Jun 08 02:12:28.010389 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:12:28.011922 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9ffb9308-f019-4e6a-97e6-6c5f98a35a80 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Returning 404 to user: Instance 111070da-9d8e-487a-8e32-60e64894d5a9 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:12:28.011922 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9ffb9308-f019-4e6a-97e6-6c5f98a35a80 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "DELETE /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9" status: 404 len: 111 microversion: 2.1 time: 0.029455 Jun 08 02:12:28.011922 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 377/768] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jun 8 02:12:27 2022] DELETE /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 08 02:12:28.015142 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2972ba4a-b043-40cf-870e-62c0f13c2280 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:28.015736 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2972ba4a-b043-40cf-870e-62c0f13c2280 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: 111070da-9d8e-487a-8e32-60e64894d5a9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:28.021299 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2972ba4a-b043-40cf-870e-62c0f13c2280 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:28.021747 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2972ba4a-b043-40cf-870e-62c0f13c2280 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:28.022493 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2972ba4a-b043-40cf-870e-62c0f13c2280 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:28.022926 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2972ba4a-b043-40cf-870e-62c0f13c2280 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:28.036648 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-2972ba4a-b043-40cf-870e-62c0f13c2280 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] HTTP exception thrown: Instance 111070da-9d8e-487a-8e32-60e64894d5a9 could not be found. Jun 08 02:12:28.038143 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2972ba4a-b043-40cf-870e-62c0f13c2280 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Request method failure captured: Jun 08 02:12:28.038143 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9 HTTP/1.1 Jun 08 02:12:28.038143 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept: application/json Jun 08 02:12:28.038143 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jun 08 02:12:28.038143 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Connection: close Jun 08 02:12:28.038143 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jun 08 02:12:28.038143 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jun 08 02:12:28.038143 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Host: 10.222.0.20 Jun 08 02:12:28.038143 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jun 08 02:12:28.038143 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jun 08 02:12:28.038143 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABioAPruCb3ZyVjnBR9xX7jet-ghimTaVPiZeXdjX5RQP3HgkXpFkIFH5N8xgnWqRgsT6I2aqtXziMXFjRQ81Zxa0cQ3vkw8PhQlhyPdcAGwi5zmqH8qiWuC3J9KnW7yZD82jUljPEBc5VOaH4zABHhrL0GaEIkKthfPNB-DUtnqK3CO9I Jun 08 02:12:28.038143 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jun 08 02:12:28.038143 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jun 08 02:12:28.038143 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jun 08 02:12:28.038143 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jun 08 02:12:28.038143 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jun 08 02:12:28.038143 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jun 08 02:12:28.038143 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Id: 27f98152ab3440cf824c9ceb1c790bcf Jun 08 02:12:28.038143 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeTestJSON-1681895122 Jun 08 02:12:28.038143 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jun 08 02:12:28.038143 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jun 08 02:12:28.040834 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27f98152ab3440cf824c9ceb1c790bcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27f98152ab3440cf824c9ceb1c790bcf", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27f98152ab3440cf824c9ceb1c790bcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27f98152ab3440cf824c9ceb1c790bcf"}]}] Jun 08 02:12:28.040834 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeTestJSON-1681895122 Jun 08 02:12:28.040834 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 27f98152ab3440cf824c9ceb1c790bcf Jun 08 02:12:28.040834 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1681895122 Jun 08 02:12:28.040834 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeTestJSON-1681895122-project Jun 08 02:12:28.040834 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jun 08 02:12:28.040834 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jun 08 02:12:28.040834 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Id: 1b43d2b8b9084099b832332a565e741c Jun 08 02:12:28.040834 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeTestJSON-1681895122-project Jun 08 02:12:28.040834 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: method: > Jun 08 02:12:28.040834 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: exception: Instance 111070da-9d8e-487a-8e32-60e64894d5a9 could not be found. Jun 08 02:12:28.040834 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: action_args: {'id': '111070da-9d8e-487a-8e32-60e64894d5a9'} Jun 08 02:12:28.041794 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:12:28.041794 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:12:28.041794 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:12:28.041794 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:12:28.041794 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:12:28.041794 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:12:28.041794 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:12:28.041794 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:12:28.041794 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:12:28.041794 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:12:28.041794 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 111070da-9d8e-487a-8e32-60e64894d5a9 could not be found. Jun 08 02:12:28.041794 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:12:28.041794 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:12:28.041794 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:12:28.041794 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:12:28.041794 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:12:28.041794 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:12:28.041794 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:12:28.041794 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:12:28.041794 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:12:28.043455 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:12:28.043455 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 02:12:28.043455 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 02:12:28.043455 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:12:28.043455 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:12:28.043455 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:12:28.043455 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:12:28.043455 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 111070da-9d8e-487a-8e32-60e64894d5a9 could not be found. Jun 08 02:12:28.043455 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:12:28.043455 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:12:28.043455 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:12:28.043455 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:12:28.043455 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:12:28.043455 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:12:28.043455 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:12:28.043455 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:12:28.043455 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 111070da-9d8e-487a-8e32-60e64894d5a9 could not be found. Jun 08 02:12:28.043455 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:12:28.044791 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2972ba4a-b043-40cf-870e-62c0f13c2280 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Returning 404 to user: Instance 111070da-9d8e-487a-8e32-60e64894d5a9 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:12:28.044791 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2972ba4a-b043-40cf-870e-62c0f13c2280 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9" status: 404 len: 111 microversion: 2.1 time: 0.028359 Jun 08 02:12:28.044791 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 378/769] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:12:28 2022] GET /compute/v2.1/servers/111070da-9d8e-487a-8e32-60e64894d5a9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 08 02:12:28.321735 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-b5715f2c-3840-4f74-946f-8275197c1a42 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "POST /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.429247 Jun 08 02:12:28.322512 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 392/770] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jun 8 02:12:27 2022] POST /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f/os-volume_attachments => generated 194 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:12:29.173760 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-427339d0-63bd-43f6-ad53-1a180d7ad92a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:29.174238 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-427339d0-63bd-43f6-ad53-1a180d7ad92a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:29.181666 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-427339d0-63bd-43f6-ad53-1a180d7ad92a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:29.182122 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-427339d0-63bd-43f6-ad53-1a180d7ad92a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:29.182887 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-427339d0-63bd-43f6-ad53-1a180d7ad92a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:29.183325 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-427339d0-63bd-43f6-ad53-1a180d7ad92a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:29.196786 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-427339d0-63bd-43f6-ad53-1a180d7ad92a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] HTTP exception thrown: Instance b508446f-daa7-46a1-be64-fd8528cfa380 could not be found. Jun 08 02:12:29.198320 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-427339d0-63bd-43f6-ad53-1a180d7ad92a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Request method failure captured: Jun 08 02:12:29.198320 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: request: DELETE /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 HTTP/1.1 Jun 08 02:12:29.198320 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept: application/json Jun 08 02:12:29.198320 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jun 08 02:12:29.198320 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Connection: close Jun 08 02:12:29.198320 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jun 08 02:12:29.198320 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jun 08 02:12:29.198320 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Host: 10.222.0.20 Jun 08 02:12:29.198320 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jun 08 02:12:29.198320 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jun 08 02:12:29.198320 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABioAPruCb3ZyVjnBR9xX7jet-ghimTaVPiZeXdjX5RQP3HgkXpFkIFH5N8xgnWqRgsT6I2aqtXziMXFjRQ81Zxa0cQ3vkw8PhQlhyPdcAGwi5zmqH8qiWuC3J9KnW7yZD82jUljPEBc5VOaH4zABHhrL0GaEIkKthfPNB-DUtnqK3CO9I Jun 08 02:12:29.198320 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jun 08 02:12:29.198320 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jun 08 02:12:29.198320 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jun 08 02:12:29.198320 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jun 08 02:12:29.198320 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jun 08 02:12:29.198320 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jun 08 02:12:29.198320 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Id: 27f98152ab3440cf824c9ceb1c790bcf Jun 08 02:12:29.198320 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeTestJSON-1681895122 Jun 08 02:12:29.198320 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jun 08 02:12:29.198320 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jun 08 02:12:29.199816 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27f98152ab3440cf824c9ceb1c790bcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27f98152ab3440cf824c9ceb1c790bcf", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27f98152ab3440cf824c9ceb1c790bcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27f98152ab3440cf824c9ceb1c790bcf"}]}] Jun 08 02:12:29.199816 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeTestJSON-1681895122 Jun 08 02:12:29.199816 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 27f98152ab3440cf824c9ceb1c790bcf Jun 08 02:12:29.199816 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1681895122 Jun 08 02:12:29.199816 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeTestJSON-1681895122-project Jun 08 02:12:29.199816 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jun 08 02:12:29.199816 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jun 08 02:12:29.199816 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Id: 1b43d2b8b9084099b832332a565e741c Jun 08 02:12:29.199816 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeTestJSON-1681895122-project Jun 08 02:12:29.199816 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: method: > Jun 08 02:12:29.199816 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: exception: Instance b508446f-daa7-46a1-be64-fd8528cfa380 could not be found. Jun 08 02:12:29.199816 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: action_args: {'id': 'b508446f-daa7-46a1-be64-fd8528cfa380'} Jun 08 02:12:29.200679 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:12:29.200679 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:12:29.200679 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:12:29.200679 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:12:29.200679 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:12:29.200679 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:12:29.200679 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:12:29.200679 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:12:29.200679 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:12:29.200679 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:12:29.200679 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b508446f-daa7-46a1-be64-fd8528cfa380 could not be found. Jun 08 02:12:29.200679 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:12:29.200679 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:12:29.200679 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:12:29.200679 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:12:29.200679 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:12:29.200679 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:12:29.200679 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:12:29.200679 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:12:29.200679 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:12:29.201990 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:12:29.201990 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 08 02:12:29.201990 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 08 02:12:29.201990 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 08 02:12:29.201990 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 08 02:12:29.201990 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:12:29.201990 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:12:29.201990 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:12:29.201990 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:12:29.201990 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b508446f-daa7-46a1-be64-fd8528cfa380 could not be found. Jun 08 02:12:29.201990 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:12:29.201990 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:12:29.201990 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:12:29.201990 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:12:29.201990 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:12:29.201990 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:12:29.201990 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:12:29.201990 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:12:29.201990 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b508446f-daa7-46a1-be64-fd8528cfa380 could not be found. Jun 08 02:12:29.201990 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:12:29.203418 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-427339d0-63bd-43f6-ad53-1a180d7ad92a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Returning 404 to user: Instance b508446f-daa7-46a1-be64-fd8528cfa380 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:12:29.203418 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-427339d0-63bd-43f6-ad53-1a180d7ad92a tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 404 len: 111 microversion: 2.1 time: 0.029924 Jun 08 02:12:29.203418 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 379/771] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jun 8 02:12:29 2022] DELETE /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 02:12:29.209235 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-5016bc9b-8d6a-44f0-a4b8-ccdc6bfac547 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:29.209981 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-5016bc9b-8d6a-44f0-a4b8-ccdc6bfac547 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] [instance: b508446f-daa7-46a1-be64-fd8528cfa380] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:29.216104 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5016bc9b-8d6a-44f0-a4b8-ccdc6bfac547 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:29.216594 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5016bc9b-8d6a-44f0-a4b8-ccdc6bfac547 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:29.217350 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5016bc9b-8d6a-44f0-a4b8-ccdc6bfac547 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:29.217787 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5016bc9b-8d6a-44f0-a4b8-ccdc6bfac547 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:29.231159 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-5016bc9b-8d6a-44f0-a4b8-ccdc6bfac547 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] HTTP exception thrown: Instance b508446f-daa7-46a1-be64-fd8528cfa380 could not be found. Jun 08 02:12:29.232767 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-5016bc9b-8d6a-44f0-a4b8-ccdc6bfac547 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Request method failure captured: Jun 08 02:12:29.232767 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 HTTP/1.1 Jun 08 02:12:29.232767 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept: application/json Jun 08 02:12:29.232767 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jun 08 02:12:29.232767 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Connection: close Jun 08 02:12:29.232767 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jun 08 02:12:29.232767 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jun 08 02:12:29.232767 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Host: 10.222.0.20 Jun 08 02:12:29.232767 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jun 08 02:12:29.232767 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jun 08 02:12:29.232767 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABioAPruCb3ZyVjnBR9xX7jet-ghimTaVPiZeXdjX5RQP3HgkXpFkIFH5N8xgnWqRgsT6I2aqtXziMXFjRQ81Zxa0cQ3vkw8PhQlhyPdcAGwi5zmqH8qiWuC3J9KnW7yZD82jUljPEBc5VOaH4zABHhrL0GaEIkKthfPNB-DUtnqK3CO9I Jun 08 02:12:29.232767 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jun 08 02:12:29.232767 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jun 08 02:12:29.232767 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jun 08 02:12:29.232767 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jun 08 02:12:29.232767 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jun 08 02:12:29.232767 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jun 08 02:12:29.232767 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Id: 27f98152ab3440cf824c9ceb1c790bcf Jun 08 02:12:29.232767 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-AttachVolumeTestJSON-1681895122 Jun 08 02:12:29.232767 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jun 08 02:12:29.232767 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jun 08 02:12:29.234342 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27f98152ab3440cf824c9ceb1c790bcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27f98152ab3440cf824c9ceb1c790bcf", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27f98152ab3440cf824c9ceb1c790bcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27f98152ab3440cf824c9ceb1c790bcf"}]}] Jun 08 02:12:29.234342 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-AttachVolumeTestJSON-1681895122 Jun 08 02:12:29.234342 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 27f98152ab3440cf824c9ceb1c790bcf Jun 08 02:12:29.234342 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1681895122 Jun 08 02:12:29.234342 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User: tempest-AttachVolumeTestJSON-1681895122-project Jun 08 02:12:29.234342 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jun 08 02:12:29.234342 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jun 08 02:12:29.234342 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Id: 1b43d2b8b9084099b832332a565e741c Jun 08 02:12:29.234342 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-AttachVolumeTestJSON-1681895122-project Jun 08 02:12:29.234342 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: method: > Jun 08 02:12:29.234342 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: exception: Instance b508446f-daa7-46a1-be64-fd8528cfa380 could not be found. Jun 08 02:12:29.234342 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: action_args: {'id': 'b508446f-daa7-46a1-be64-fd8528cfa380'} Jun 08 02:12:29.235375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:12:29.235375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:12:29.235375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:12:29.235375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:12:29.235375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:12:29.235375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:12:29.235375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:12:29.235375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:12:29.235375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:12:29.235375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:12:29.235375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b508446f-daa7-46a1-be64-fd8528cfa380 could not be found. Jun 08 02:12:29.235375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:12:29.235375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:12:29.235375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:12:29.235375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:12:29.235375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:12:29.235375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:12:29.235375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:12:29.235375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:12:29.235375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:12:29.236592 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:12:29.236592 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 02:12:29.236592 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 02:12:29.236592 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:12:29.236592 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:12:29.236592 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:12:29.236592 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:12:29.236592 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b508446f-daa7-46a1-be64-fd8528cfa380 could not be found. Jun 08 02:12:29.236592 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:12:29.236592 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:12:29.236592 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:12:29.236592 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:12:29.236592 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:12:29.236592 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:12:29.236592 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:12:29.236592 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:12:29.236592 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b508446f-daa7-46a1-be64-fd8528cfa380 could not be found. Jun 08 02:12:29.236592 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:12:29.237745 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-5016bc9b-8d6a-44f0-a4b8-ccdc6bfac547 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] Returning 404 to user: Instance b508446f-daa7-46a1-be64-fd8528cfa380 could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:12:29.237745 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-5016bc9b-8d6a-44f0-a4b8-ccdc6bfac547 tempest-AttachVolumeTestJSON-1681895122 tempest-AttachVolumeTestJSON-1681895122-project] 10.222.0.20 "GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380" status: 404 len: 111 microversion: 2.1 time: 0.029622 Jun 08 02:12:29.237745 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 393/772] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:12:29 2022] GET /compute/v2.1/servers/b508446f-daa7-46a1-be64-fd8528cfa380 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 02:12:35.872991 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-31d5bdb4-1256-4481-9b87-ba296ca03aa2 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:35.873600 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-31d5bdb4-1256-4481-9b87-ba296ca03aa2 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:35.880280 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-31d5bdb4-1256-4481-9b87-ba296ca03aa2 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:35.880757 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-31d5bdb4-1256-4481-9b87-ba296ca03aa2 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:35.881514 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-31d5bdb4-1256-4481-9b87-ba296ca03aa2 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:35.881954 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-31d5bdb4-1256-4481-9b87-ba296ca03aa2 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:36.248442 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-31d5bdb4-1256-4481-9b87-ba296ca03aa2 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:36.256296 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-31d5bdb4-1256-4481-9b87-ba296ca03aa2 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1595 microversion: 2.1 time: 0.387238 Jun 08 02:12:36.256877 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 380/773] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:12:35 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1595 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:12:38.136672 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-dd6badc4-52d6-4b3d-9178-81f0630bc523 req-0e1081a6-edfe-4c08-953f-d07657a22a51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b532af5d-7b14-4644-add7-8b716f81871f", "tag": "906aaccc-01a6-40cf-a960-5f798d175167"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:12:38.153205 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=2 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:12:38.155446 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-dd6badc4-52d6-4b3d-9178-81f0630bc523 req-0e1081a6-edfe-4c08-953f-d07657a22a51 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:38.155887 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-dd6badc4-52d6-4b3d-9178-81f0630bc523 req-0e1081a6-edfe-4c08-953f-d07657a22a51 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:38.169391 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-dd6badc4-52d6-4b3d-9178-81f0630bc523 req-0e1081a6-edfe-4c08-953f-d07657a22a51 service nova] Creating event network-changed:906aaccc-01a6-40cf-a960-5f798d175167 for instance b532af5d-7b14-4644-add7-8b716f81871f on hv-cinder-84506 Jun 08 02:12:38.175179 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-dd6badc4-52d6-4b3d-9178-81f0630bc523 req-0e1081a6-edfe-4c08-953f-d07657a22a51 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044578 Jun 08 02:12:38.176137 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 394/774] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 02:12:39.409871 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-94505b0b-8ac7-4b81-a479-27b82f150f99 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-622762087"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:12:39.410397 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-94505b0b-8ac7-4b81-a479-27b82f150f99 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:39.417925 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-94505b0b-8ac7-4b81-a479-27b82f150f99 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:39.418384 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-94505b0b-8ac7-4b81-a479-27b82f150f99 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:39.419156 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-94505b0b-8ac7-4b81-a479-27b82f150f99 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:39.419592 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-94505b0b-8ac7-4b81-a479-27b82f150f99 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:39.574134 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.network.security_group_api [None req-94505b0b-8ac7-4b81-a479-27b82f150f99 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Adding security group 49f602e6-cd7d-4297-b234-3cdf7556d07e to port 906aaccc-01a6-40cf-a960-5f798d175167 Jun 08 02:12:39.995671 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-94505b0b-8ac7-4b81-a479-27b82f150f99 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "POST /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f/action" status: 202 len: 0 microversion: 2.1 time: 0.589804 Jun 08 02:12:39.996619 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 381/775] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jun 8 02:12:39 2022] POST /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f/action => generated 0 bytes in 591 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 02:12:40.005315 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-70eef64a-19b7-4b80-a222-7223705c058d tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:40.006124 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-70eef64a-19b7-4b80-a222-7223705c058d tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:40.016188 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-70eef64a-19b7-4b80-a222-7223705c058d tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:40.018228 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-70eef64a-19b7-4b80-a222-7223705c058d tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:40.019295 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-70eef64a-19b7-4b80-a222-7223705c058d tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:40.020911 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-70eef64a-19b7-4b80-a222-7223705c058d tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:40.195349 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-1a344447-93f5-478d-8083-a4977c85e696 req-f08b1737-3654-4a53-bff4-8799a0f44bca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b532af5d-7b14-4644-add7-8b716f81871f", "tag": "906aaccc-01a6-40cf-a960-5f798d175167"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:12:40.218383 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-70eef64a-19b7-4b80-a222-7223705c058d tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:40.226614 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-1a344447-93f5-478d-8083-a4977c85e696 req-f08b1737-3654-4a53-bff4-8799a0f44bca service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:40.232856 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-70eef64a-19b7-4b80-a222-7223705c058d tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1760 microversion: 2.1 time: 0.232159 Jun 08 02:12:40.234014 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 395/776] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:12:39 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1760 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:12:40.234768 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-1a344447-93f5-478d-8083-a4977c85e696 req-f08b1737-3654-4a53-bff4-8799a0f44bca service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:40.253982 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-1a344447-93f5-478d-8083-a4977c85e696 req-f08b1737-3654-4a53-bff4-8799a0f44bca service nova] Creating event network-changed:906aaccc-01a6-40cf-a960-5f798d175167 for instance b532af5d-7b14-4644-add7-8b716f81871f on hv-cinder-84506 Jun 08 02:12:40.259389 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-1a344447-93f5-478d-8083-a4977c85e696 req-f08b1737-3654-4a53-bff4-8799a0f44bca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068024 Jun 08 02:12:40.260324 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 382/777] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:12:49.341178 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 08 02:12:49.341722 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Wed Jun 8 02:12:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 08 02:12:52.826781 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f5228f4a-601f-466a-a0c0-c4c5613ff047 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:52.827866 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f5228f4a-601f-466a-a0c0-c4c5613ff047 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:52.830359 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=13 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:12:52.831014 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:12:52.836974 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f5228f4a-601f-466a-a0c0-c4c5613ff047 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:52.837445 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f5228f4a-601f-466a-a0c0-c4c5613ff047 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:52.838236 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f5228f4a-601f-466a-a0c0-c4c5613ff047 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:52.838699 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f5228f4a-601f-466a-a0c0-c4c5613ff047 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:52.869871 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f5228f4a-601f-466a-a0c0-c4c5613ff047 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047869 Jun 08 02:12:52.870443 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 396/778] 10.222.0.20 () {60 vars in 1342 bytes} [Wed Jun 8 02:12:52 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:12:52.934469 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=13 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:12:52.935116 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=68 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:12:52.940071 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-08da2437-46fd-4a96-8fa1-3787b543d6f5 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:52.940609 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-08da2437-46fd-4a96-8fa1-3787b543d6f5 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:52.947868 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-08da2437-46fd-4a96-8fa1-3787b543d6f5 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:52.948305 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-08da2437-46fd-4a96-8fa1-3787b543d6f5 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:52.949101 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-08da2437-46fd-4a96-8fa1-3787b543d6f5 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:52.949529 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-08da2437-46fd-4a96-8fa1-3787b543d6f5 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:52.975550 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-08da2437-46fd-4a96-8fa1-3787b543d6f5 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Going to try to terminate instance {{(pid=117938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 02:12:53.062722 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-08da2437-46fd-4a96-8fa1-3787b543d6f5 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "DELETE /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 204 len: 0 microversion: 2.20 time: 0.129571 Jun 08 02:12:53.063435 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 383/779] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Jun 8 02:12:52 2022] DELETE /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 08 02:12:53.071447 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a1fbb723-cf92-4d66-9476-e874da9f15f0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:53.072053 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a1fbb723-cf92-4d66-9476-e874da9f15f0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:53.078157 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a1fbb723-cf92-4d66-9476-e874da9f15f0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:53.078618 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a1fbb723-cf92-4d66-9476-e874da9f15f0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:53.079455 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a1fbb723-cf92-4d66-9476-e874da9f15f0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:53.079894 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a1fbb723-cf92-4d66-9476-e874da9f15f0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:53.217874 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a1fbb723-cf92-4d66-9476-e874da9f15f0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:53.226377 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a1fbb723-cf92-4d66-9476-e874da9f15f0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:53.227917 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a1fbb723-cf92-4d66-9476-e874da9f15f0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:53.229115 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a1fbb723-cf92-4d66-9476-e874da9f15f0 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1724 microversion: 2.20 time: 0.161530 Jun 08 02:12:53.229667 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 397/780] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:12:53 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:12:53.786452 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-36cc77c6-0f7b-4fab-8e0a-e0f1deead9d7 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:53.787025 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-36cc77c6-0f7b-4fab-8e0a-e0f1deead9d7 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:53.793640 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-36cc77c6-0f7b-4fab-8e0a-e0f1deead9d7 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:53.794085 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-36cc77c6-0f7b-4fab-8e0a-e0f1deead9d7 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:53.795620 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-36cc77c6-0f7b-4fab-8e0a-e0f1deead9d7 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:53.796057 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-36cc77c6-0f7b-4fab-8e0a-e0f1deead9d7 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:53.825476 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-36cc77c6-0f7b-4fab-8e0a-e0f1deead9d7 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Going to try to terminate instance {{(pid=117938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 02:12:53.922674 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-36cc77c6-0f7b-4fab-8e0a-e0f1deead9d7 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 204 len: 0 microversion: 2.1 time: 0.140144 Jun 08 02:12:53.923396 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 384/781] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jun 8 02:12:53 2022] DELETE /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 08 02:12:53.932816 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2757b66c-6631-4749-8748-9223ca9fe21d tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:53.933513 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2757b66c-6631-4749-8748-9223ca9fe21d tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:53.940931 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-6e0d7715-5ffa-4b70-aa21-7e5869fa1eab req-b560b815-080b-4d6b-86be-3f2398edc514 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cf1e158-1c3a-488c-8227-d7279cea2978", "tag": "8bbb59fb-caf5-486d-bd77-92280696e47b"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:12:53.948831 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2757b66c-6631-4749-8748-9223ca9fe21d tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:53.949300 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-6e0d7715-5ffa-4b70-aa21-7e5869fa1eab req-b560b815-080b-4d6b-86be-3f2398edc514 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:53.949300 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-6e0d7715-5ffa-4b70-aa21-7e5869fa1eab req-b560b815-080b-4d6b-86be-3f2398edc514 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:53.949557 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2757b66c-6631-4749-8748-9223ca9fe21d tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:53.950418 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2757b66c-6631-4749-8748-9223ca9fe21d tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:53.951512 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2757b66c-6631-4749-8748-9223ca9fe21d tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:53.961346 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-6e0d7715-5ffa-4b70-aa21-7e5869fa1eab req-b560b815-080b-4d6b-86be-3f2398edc514 service nova] Creating event network-changed:8bbb59fb-caf5-486d-bd77-92280696e47b for instance 4cf1e158-1c3a-488c-8227-d7279cea2978 on hv-cinder-84506 Jun 08 02:12:53.967779 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-6e0d7715-5ffa-4b70-aa21-7e5869fa1eab req-b560b815-080b-4d6b-86be-3f2398edc514 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183220 Jun 08 02:12:53.968381 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 398/782] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:12:54.101098 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2757b66c-6631-4749-8748-9223ca9fe21d tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:54.108646 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2757b66c-6631-4749-8748-9223ca9fe21d tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1569 microversion: 2.1 time: 0.180675 Jun 08 02:12:54.109217 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 385/783] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:12:53 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1569 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:12:54.248752 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-31cc5c3b-4685-45e6-91ba-50f1cf8fa098 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:54.249462 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-31cc5c3b-4685-45e6-91ba-50f1cf8fa098 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:54.261854 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-31cc5c3b-4685-45e6-91ba-50f1cf8fa098 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:54.262294 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-31cc5c3b-4685-45e6-91ba-50f1cf8fa098 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:54.263094 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-31cc5c3b-4685-45e6-91ba-50f1cf8fa098 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:54.263516 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-31cc5c3b-4685-45e6-91ba-50f1cf8fa098 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:54.409488 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-31cc5c3b-4685-45e6-91ba-50f1cf8fa098 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:54.417690 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-31cc5c3b-4685-45e6-91ba-50f1cf8fa098 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:54.419821 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-31cc5c3b-4685-45e6-91ba-50f1cf8fa098 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:54.421382 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-31cc5c3b-4685-45e6-91ba-50f1cf8fa098 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1724 microversion: 2.20 time: 0.178041 Jun 08 02:12:54.421927 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 399/784] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:12:54 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:12:55.126321 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-482450f1-852a-4568-961f-f252ea676359 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:55.126930 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-482450f1-852a-4568-961f-f252ea676359 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:55.133446 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-482450f1-852a-4568-961f-f252ea676359 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:55.133893 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-482450f1-852a-4568-961f-f252ea676359 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:55.134649 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-482450f1-852a-4568-961f-f252ea676359 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:55.135080 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-482450f1-852a-4568-961f-f252ea676359 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:55.271684 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-482450f1-852a-4568-961f-f252ea676359 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:55.280097 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-482450f1-852a-4568-961f-f252ea676359 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1569 microversion: 2.1 time: 0.157986 Jun 08 02:12:55.280699 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 386/785] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:12:55 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:12:55.440145 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-92f9628e-7d4d-463e-9de3-0831c8f53179 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:55.440773 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-92f9628e-7d4d-463e-9de3-0831c8f53179 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:55.447191 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-92f9628e-7d4d-463e-9de3-0831c8f53179 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:55.447633 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-92f9628e-7d4d-463e-9de3-0831c8f53179 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:55.448380 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-92f9628e-7d4d-463e-9de3-0831c8f53179 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:55.448834 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-92f9628e-7d4d-463e-9de3-0831c8f53179 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:55.579806 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-92f9628e-7d4d-463e-9de3-0831c8f53179 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:55.588151 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-92f9628e-7d4d-463e-9de3-0831c8f53179 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:55.589670 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-92f9628e-7d4d-463e-9de3-0831c8f53179 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:55.590893 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-92f9628e-7d4d-463e-9de3-0831c8f53179 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1724 microversion: 2.20 time: 0.154937 Jun 08 02:12:55.591724 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 400/786] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:12:55 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:12:56.298412 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-43399086-4e76-4344-9002-3fc43ac9174e tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:56.299019 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-43399086-4e76-4344-9002-3fc43ac9174e tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:56.305653 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-43399086-4e76-4344-9002-3fc43ac9174e tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:56.306304 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-43399086-4e76-4344-9002-3fc43ac9174e tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:56.307070 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-43399086-4e76-4344-9002-3fc43ac9174e tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:56.307502 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-43399086-4e76-4344-9002-3fc43ac9174e tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:56.611540 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0a867320-9dc2-4bc2-af4e-1b7dd6108c4c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:56.612157 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-0a867320-9dc2-4bc2-af4e-1b7dd6108c4c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:56.619355 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0a867320-9dc2-4bc2-af4e-1b7dd6108c4c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:56.619798 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0a867320-9dc2-4bc2-af4e-1b7dd6108c4c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:56.620602 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0a867320-9dc2-4bc2-af4e-1b7dd6108c4c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:56.621911 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0a867320-9dc2-4bc2-af4e-1b7dd6108c4c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:56.687864 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-43399086-4e76-4344-9002-3fc43ac9174e tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c126e7436243559b25981f5ca7c74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e5d438bb1f4eb28d3f3f68d77b5dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:56.697040 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-43399086-4e76-4344-9002-3fc43ac9174e tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 200 len: 1569 microversion: 2.1 time: 0.402976 Jun 08 02:12:56.697701 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 387/787] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:12:56 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 1569 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:12:56.703735 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-7a85a4b3-17b7-405b-b739-9dd9aef08188 req-0f054c0d-6c70-4dee-bbab-55d8972b975c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cf1e158-1c3a-488c-8227-d7279cea2978", "name": "network-vif-deleted", "tag": "8bbb59fb-caf5-486d-bd77-92280696e47b"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:12:56.713974 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-7a85a4b3-17b7-405b-b739-9dd9aef08188 req-0f054c0d-6c70-4dee-bbab-55d8972b975c service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:56.714513 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-7a85a4b3-17b7-405b-b739-9dd9aef08188 req-0f054c0d-6c70-4dee-bbab-55d8972b975c service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:56.728302 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-7a85a4b3-17b7-405b-b739-9dd9aef08188 req-0f054c0d-6c70-4dee-bbab-55d8972b975c service nova] Creating event network-vif-deleted:8bbb59fb-caf5-486d-bd77-92280696e47b for instance 4cf1e158-1c3a-488c-8227-d7279cea2978 on hv-cinder-84506 Jun 08 02:12:56.734605 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-7a85a4b3-17b7-405b-b739-9dd9aef08188 req-0f054c0d-6c70-4dee-bbab-55d8972b975c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035647 Jun 08 02:12:56.735414 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 388/788] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:12:56.975924 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-0a867320-9dc2-4bc2-af4e-1b7dd6108c4c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:56.986114 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-0a867320-9dc2-4bc2-af4e-1b7dd6108c4c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:56.987911 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-0a867320-9dc2-4bc2-af4e-1b7dd6108c4c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:56.989292 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-0a867320-9dc2-4bc2-af4e-1b7dd6108c4c tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1724 microversion: 2.20 time: 0.382940 Jun 08 02:12:56.990833 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 401/789] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:12:56 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1724 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:12:57.533559 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-9bc5ced0-3adc-40e2-a807-3d26c8e7e7dc req-986a7535-fbde-42f7-9441-c642f1cd7af4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19726b62-06f4-4547-9021-b58c9571f183", "name": "network-vif-deleted", "tag": "92dccdf3-f4c8-42b5-aee4-d2373577dd65"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:12:57.546994 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-9bc5ced0-3adc-40e2-a807-3d26c8e7e7dc req-986a7535-fbde-42f7-9441-c642f1cd7af4 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:57.547712 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-9bc5ced0-3adc-40e2-a807-3d26c8e7e7dc req-986a7535-fbde-42f7-9441-c642f1cd7af4 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:57.561588 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-9bc5ced0-3adc-40e2-a807-3d26c8e7e7dc req-986a7535-fbde-42f7-9441-c642f1cd7af4 service nova] Creating event network-vif-deleted:92dccdf3-f4c8-42b5-aee4-d2373577dd65 for instance 19726b62-06f4-4547-9021-b58c9571f183 on hv-cinder-84506 Jun 08 02:12:57.567545 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-9bc5ced0-3adc-40e2-a807-3d26c8e7e7dc req-986a7535-fbde-42f7-9441-c642f1cd7af4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039028 Jun 08 02:12:57.568157 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 389/790] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:12:57.717582 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f6d11227-46b8-4e80-be83-75b8bd1484a2 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:57.717582 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f6d11227-46b8-4e80-be83-75b8bd1484a2 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] [instance: 4cf1e158-1c3a-488c-8227-d7279cea2978] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:57.727097 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f6d11227-46b8-4e80-be83-75b8bd1484a2 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:57.727470 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f6d11227-46b8-4e80-be83-75b8bd1484a2 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:57.728254 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f6d11227-46b8-4e80-be83-75b8bd1484a2 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:57.728717 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f6d11227-46b8-4e80-be83-75b8bd1484a2 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:57.754449 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-f6d11227-46b8-4e80-be83-75b8bd1484a2 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] HTTP exception thrown: Instance 4cf1e158-1c3a-488c-8227-d7279cea2978 could not be found. Jun 08 02:12:57.756209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f6d11227-46b8-4e80-be83-75b8bd1484a2 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Request method failure captured: Jun 08 02:12:57.756209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 HTTP/1.1 Jun 08 02:12:57.756209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept: application/json Jun 08 02:12:57.756209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jun 08 02:12:57.756209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Connection: close Jun 08 02:12:57.756209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jun 08 02:12:57.756209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jun 08 02:12:57.756209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Host: 10.222.0.20 Jun 08 02:12:57.756209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jun 08 02:12:57.756209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jun 08 02:12:57.756209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABioARss7xs0PoDt2GtZ0dbqIzSz3Jvd5Wj_YagXShHUSHMQgZLuo6zUJWW4Oc_Wx5kqkgf8uMPznNhqnMmTOOjXJX8hcByy7cai6AGgpGwvJCf4WGfPISj-6Nvw52Dmlb7SHu1yH7DnMNsLl9jwdj_jrwmYoXb_0lvzxliWgf-l1z9Ezo Jun 08 02:12:57.756209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jun 08 02:12:57.756209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jun 08 02:12:57.756209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jun 08 02:12:57.756209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jun 08 02:12:57.756209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jun 08 02:12:57.756209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jun 08 02:12:57.756209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Id: 43e5d438bb1f4eb28d3f3f68d77b5dee Jun 08 02:12:57.756209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-TestShelveInstance-1312857821 Jun 08 02:12:57.756209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jun 08 02:12:57.756209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jun 08 02:12:57.757866 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43e5d438bb1f4eb28d3f3f68d77b5dee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_43e5d438bb1f4eb28d3f3f68d77b5dee", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/43e5d438bb1f4eb28d3f3f68d77b5dee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43e5d438bb1f4eb28d3f3f68d77b5dee"}]}] Jun 08 02:12:57.757866 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-TestShelveInstance-1312857821 Jun 08 02:12:57.757866 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 43e5d438bb1f4eb28d3f3f68d77b5dee Jun 08 02:12:57.757866 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-TestShelveInstance-1312857821 Jun 08 02:12:57.757866 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User: tempest-TestShelveInstance-1312857821-project Jun 08 02:12:57.757866 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jun 08 02:12:57.757866 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jun 08 02:12:57.757866 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Id: 00c126e7436243559b25981f5ca7c74e Jun 08 02:12:57.757866 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-TestShelveInstance-1312857821-project Jun 08 02:12:57.757866 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: method: > Jun 08 02:12:57.757866 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: exception: Instance 4cf1e158-1c3a-488c-8227-d7279cea2978 could not be found. Jun 08 02:12:57.757866 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: action_args: {'id': '4cf1e158-1c3a-488c-8227-d7279cea2978'} Jun 08 02:12:57.763696 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:12:57.763696 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:12:57.763696 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:12:57.763696 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:12:57.763696 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:12:57.763696 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:12:57.763696 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:12:57.763696 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:12:57.763696 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:12:57.763696 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:12:57.763696 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cf1e158-1c3a-488c-8227-d7279cea2978 could not be found. Jun 08 02:12:57.763696 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:12:57.763696 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:12:57.763696 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:12:57.763696 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:12:57.763696 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:12:57.763696 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:12:57.763696 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:12:57.763696 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:12:57.763696 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:12:57.765459 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:12:57.765459 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 02:12:57.765459 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 02:12:57.765459 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:12:57.765459 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:12:57.765459 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:12:57.765459 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:12:57.765459 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cf1e158-1c3a-488c-8227-d7279cea2978 could not be found. Jun 08 02:12:57.765459 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:12:57.765459 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:12:57.765459 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:12:57.765459 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:12:57.765459 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:12:57.765459 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:12:57.765459 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:12:57.765459 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:12:57.765459 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cf1e158-1c3a-488c-8227-d7279cea2978 could not be found. Jun 08 02:12:57.765459 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:12:57.767290 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f6d11227-46b8-4e80-be83-75b8bd1484a2 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Returning 404 to user: Instance 4cf1e158-1c3a-488c-8227-d7279cea2978 could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:12:57.767290 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f6d11227-46b8-4e80-be83-75b8bd1484a2 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978" status: 404 len: 111 microversion: 2.1 time: 0.045608 Jun 08 02:12:57.767290 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 402/791] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:12:57 2022] GET /compute/v2.1/servers/4cf1e158-1c3a-488c-8227-d7279cea2978 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 02:12:57.960068 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e9cbed08-01d6-4622-b88e-eae66519b5f7 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] Calling method '.version_select at 0x7f836af02b80>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:57.985533 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e9cbed08-01d6-4622-b88e-eae66519b5f7 tempest-TestShelveInstance-1312857821 tempest-TestShelveInstance-1312857821-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2096472055" status: 202 len: 0 microversion: 2.1 time: 0.035095 Jun 08 02:12:57.988883 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 390/792] 10.222.0.20 () {58 vars in 1253 bytes} [Wed Jun 8 02:12:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2096472055 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 02:12:58.011426 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-03426e37-9d57-450d-9f72-fd511a0e0ef1 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:58.012480 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-03426e37-9d57-450d-9f72-fd511a0e0ef1 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:58.032133 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-03426e37-9d57-450d-9f72-fd511a0e0ef1 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:58.033373 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-03426e37-9d57-450d-9f72-fd511a0e0ef1 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:58.035915 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-03426e37-9d57-450d-9f72-fd511a0e0ef1 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:58.037086 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-03426e37-9d57-450d-9f72-fd511a0e0ef1 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:58.082914 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-03426e37-9d57-450d-9f72-fd511a0e0ef1 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:58.083538 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-03426e37-9d57-450d-9f72-fd511a0e0ef1 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:58.084000 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.objects.instance [None req-03426e37-9d57-450d-9f72-fd511a0e0ef1 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lazy-loading 'fault' on Instance uuid 19726b62-06f4-4547-9021-b58c9571f183 {{(pid=117939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 02:12:58.136842 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-03426e37-9d57-450d-9f72-fd511a0e0ef1 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:58.146282 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-03426e37-9d57-450d-9f72-fd511a0e0ef1 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:58.150829 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-03426e37-9d57-450d-9f72-fd511a0e0ef1 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b4081bebe74c839f5aa214275210b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf0f9fd80c464ca4fbf7f2e19fccbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:12:58.152053 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-03426e37-9d57-450d-9f72-fd511a0e0ef1 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 200 len: 1371 microversion: 2.20 time: 0.147686 Jun 08 02:12:58.160829 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 403/793] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:12:58 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 02:12:59.172242 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-dfd83700-a5b1-46fb-82d2-df45525e895b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:59.173033 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-dfd83700-a5b1-46fb-82d2-df45525e895b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:12:59.179485 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dfd83700-a5b1-46fb-82d2-df45525e895b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:59.179929 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dfd83700-a5b1-46fb-82d2-df45525e895b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:59.180712 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dfd83700-a5b1-46fb-82d2-df45525e895b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:12:59.181145 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dfd83700-a5b1-46fb-82d2-df45525e895b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:12:59.200324 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-dfd83700-a5b1-46fb-82d2-df45525e895b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] HTTP exception thrown: Instance 19726b62-06f4-4547-9021-b58c9571f183 could not be found. Jun 08 02:12:59.203249 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-dfd83700-a5b1-46fb-82d2-df45525e895b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Request method failure captured: Jun 08 02:12:59.203249 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 HTTP/1.1 Jun 08 02:12:59.203249 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept: application/json Jun 08 02:12:59.203249 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jun 08 02:12:59.203249 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Connection: close Jun 08 02:12:59.203249 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jun 08 02:12:59.203249 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jun 08 02:12:59.203249 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Host: 10.222.0.20 Jun 08 02:12:59.203249 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jun 08 02:12:59.203249 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jun 08 02:12:59.203249 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABioAQ5Q-kUAsXXvLlpD_vYTS_7Cpa1UAreb9KfSGFfqnpepRbFXxhuJ2XB5BrVclykIXGPkhYy5vkv1P-6xYsW7EcD9VCdOVs5ad6zVygMxRb19EBZmRfA7p-4qsREHksD7Kz2ms_5tPzTz35DUlR3oX6FYY6jgHb8NUH7WRjcGG89vsI Jun 08 02:12:59.203249 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jun 08 02:12:59.203249 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jun 08 02:12:59.203249 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jun 08 02:12:59.203249 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jun 08 02:12:59.203249 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Openstack-Nova-Api-Version: 2.20 Jun 08 02:12:59.203249 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jun 08 02:12:59.203249 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jun 08 02:12:59.203249 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Id: 7daf0f9fd80c464ca4fbf7f2e19fccbd Jun 08 02:12:59.203249 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-248114998 Jun 08 02:12:59.203249 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jun 08 02:12:59.203249 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jun 08 02:12:59.205035 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7daf0f9fd80c464ca4fbf7f2e19fccbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7daf0f9fd80c464ca4fbf7f2e19fccbd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7daf0f9fd80c464ca4fbf7f2e19fccbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7daf0f9fd80c464ca4fbf7f2e19fccbd"}]}] Jun 08 02:12:59.205035 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeShelveTestJSON-248114998 Jun 08 02:12:59.205035 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 7daf0f9fd80c464ca4fbf7f2e19fccbd Jun 08 02:12:59.205035 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-248114998 Jun 08 02:12:59.205035 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeShelveTestJSON-248114998-project Jun 08 02:12:59.205035 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jun 08 02:12:59.205035 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jun 08 02:12:59.205035 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Id: a3b4081bebe74c839f5aa214275210b4 Jun 08 02:12:59.205035 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeShelveTestJSON-248114998-project Jun 08 02:12:59.205035 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: method: > Jun 08 02:12:59.205035 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: exception: Instance 19726b62-06f4-4547-9021-b58c9571f183 could not be found. Jun 08 02:12:59.205035 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: action_args: {'id': '19726b62-06f4-4547-9021-b58c9571f183'} Jun 08 02:12:59.205869 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:12:59.205869 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:12:59.205869 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:12:59.205869 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:12:59.205869 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:12:59.205869 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:12:59.205869 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:12:59.205869 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:12:59.205869 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:12:59.205869 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:12:59.205869 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19726b62-06f4-4547-9021-b58c9571f183 could not be found. Jun 08 02:12:59.205869 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:12:59.205869 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:12:59.205869 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:12:59.205869 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:12:59.205869 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:12:59.205869 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:12:59.205869 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:12:59.205869 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:12:59.205869 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:12:59.209979 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:12:59.209979 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 02:12:59.209979 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 02:12:59.209979 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:12:59.209979 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:12:59.209979 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:12:59.209979 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:12:59.209979 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19726b62-06f4-4547-9021-b58c9571f183 could not be found. Jun 08 02:12:59.209979 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:12:59.209979 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:12:59.209979 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:12:59.209979 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:12:59.209979 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:12:59.209979 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:12:59.209979 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:12:59.209979 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:12:59.209979 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19726b62-06f4-4547-9021-b58c9571f183 could not be found. Jun 08 02:12:59.209979 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:12:59.211357 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-dfd83700-a5b1-46fb-82d2-df45525e895b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Returning 404 to user: Instance 19726b62-06f4-4547-9021-b58c9571f183 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:12:59.211357 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-dfd83700-a5b1-46fb-82d2-df45525e895b tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 404 len: 111 microversion: 2.20 time: 0.037473 Jun 08 02:12:59.211357 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 391/794] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:12:59 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 08 02:12:59.218307 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-92a6a1c7-12c0-4d03-a601-552b51832385 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '.version_select at 0x7f836aef5ee0>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:12:59.250519 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-92a6a1c7-12c0-4d03-a601-552b51832385 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1270933572" status: 204 len: 0 microversion: 2.20 time: 0.037589 Jun 08 02:12:59.251206 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 404/795] 10.222.0.20 () {60 vars in 1261 bytes} [Wed Jun 8 02:12:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1270933572 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 08 02:13:01.211082 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e8d99eb1-f551-4f30-8628-34b3d93faf11 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:13:01.211690 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e8d99eb1-f551-4f30-8628-34b3d93faf11 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:13:01.218774 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e8d99eb1-f551-4f30-8628-34b3d93faf11 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:01.219291 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e8d99eb1-f551-4f30-8628-34b3d93faf11 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:01.220122 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e8d99eb1-f551-4f30-8628-34b3d93faf11 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:01.220653 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e8d99eb1-f551-4f30-8628-34b3d93faf11 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:01.235696 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-e8d99eb1-f551-4f30-8628-34b3d93faf11 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] HTTP exception thrown: Instance 19726b62-06f4-4547-9021-b58c9571f183 could not be found. Jun 08 02:13:01.237463 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e8d99eb1-f551-4f30-8628-34b3d93faf11 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Request method failure captured: Jun 08 02:13:01.237463 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: request: DELETE /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 HTTP/1.1 Jun 08 02:13:01.237463 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept: application/json Jun 08 02:13:01.237463 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jun 08 02:13:01.237463 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Connection: close Jun 08 02:13:01.237463 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jun 08 02:13:01.237463 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jun 08 02:13:01.237463 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Host: 10.222.0.20 Jun 08 02:13:01.237463 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jun 08 02:13:01.237463 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jun 08 02:13:01.237463 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABioAQ5Q-kUAsXXvLlpD_vYTS_7Cpa1UAreb9KfSGFfqnpepRbFXxhuJ2XB5BrVclykIXGPkhYy5vkv1P-6xYsW7EcD9VCdOVs5ad6zVygMxRb19EBZmRfA7p-4qsREHksD7Kz2ms_5tPzTz35DUlR3oX6FYY6jgHb8NUH7WRjcGG89vsI Jun 08 02:13:01.237463 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jun 08 02:13:01.237463 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jun 08 02:13:01.237463 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jun 08 02:13:01.237463 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jun 08 02:13:01.237463 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Openstack-Nova-Api-Version: 2.20 Jun 08 02:13:01.237463 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jun 08 02:13:01.237463 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jun 08 02:13:01.237463 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Id: 7daf0f9fd80c464ca4fbf7f2e19fccbd Jun 08 02:13:01.237463 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-248114998 Jun 08 02:13:01.237463 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jun 08 02:13:01.237463 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jun 08 02:13:01.239145 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7daf0f9fd80c464ca4fbf7f2e19fccbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7daf0f9fd80c464ca4fbf7f2e19fccbd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7daf0f9fd80c464ca4fbf7f2e19fccbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7daf0f9fd80c464ca4fbf7f2e19fccbd"}]}] Jun 08 02:13:01.239145 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeShelveTestJSON-248114998 Jun 08 02:13:01.239145 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 7daf0f9fd80c464ca4fbf7f2e19fccbd Jun 08 02:13:01.239145 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-248114998 Jun 08 02:13:01.239145 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeShelveTestJSON-248114998-project Jun 08 02:13:01.239145 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jun 08 02:13:01.239145 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jun 08 02:13:01.239145 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Id: a3b4081bebe74c839f5aa214275210b4 Jun 08 02:13:01.239145 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeShelveTestJSON-248114998-project Jun 08 02:13:01.239145 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: method: > Jun 08 02:13:01.239145 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: exception: Instance 19726b62-06f4-4547-9021-b58c9571f183 could not be found. Jun 08 02:13:01.239145 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: action_args: {'id': '19726b62-06f4-4547-9021-b58c9571f183'} Jun 08 02:13:01.240024 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:13:01.240024 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:13:01.240024 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:13:01.240024 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:13:01.240024 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:13:01.240024 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:13:01.240024 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:13:01.240024 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:13:01.240024 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:13:01.240024 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:13:01.240024 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19726b62-06f4-4547-9021-b58c9571f183 could not be found. Jun 08 02:13:01.240024 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:13:01.240024 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:13:01.240024 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:13:01.240024 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:13:01.240024 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:13:01.240024 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:13:01.240024 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:13:01.240024 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:13:01.240024 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:13:01.241317 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:13:01.241317 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 08 02:13:01.241317 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 08 02:13:01.241317 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 08 02:13:01.241317 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 08 02:13:01.241317 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:13:01.241317 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:13:01.241317 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:13:01.241317 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:13:01.241317 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19726b62-06f4-4547-9021-b58c9571f183 could not be found. Jun 08 02:13:01.241317 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:13:01.241317 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:13:01.241317 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:13:01.241317 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:13:01.241317 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:13:01.241317 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:13:01.241317 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:13:01.241317 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:13:01.241317 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19726b62-06f4-4547-9021-b58c9571f183 could not be found. Jun 08 02:13:01.241317 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:13:01.242704 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e8d99eb1-f551-4f30-8628-34b3d93faf11 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Returning 404 to user: Instance 19726b62-06f4-4547-9021-b58c9571f183 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:13:01.242704 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e8d99eb1-f551-4f30-8628-34b3d93faf11 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "DELETE /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 404 len: 111 microversion: 2.20 time: 0.032354 Jun 08 02:13:01.242704 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 392/796] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Jun 8 02:13:01 2022] DELETE /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 08 02:13:01.250196 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b1dfe4d9-8eab-4200-84de-3dc2c21a5b27 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:13:01.250807 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-b1dfe4d9-8eab-4200-84de-3dc2c21a5b27 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: 19726b62-06f4-4547-9021-b58c9571f183] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:13:01.268770 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b1dfe4d9-8eab-4200-84de-3dc2c21a5b27 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:01.269898 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b1dfe4d9-8eab-4200-84de-3dc2c21a5b27 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:01.271209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b1dfe4d9-8eab-4200-84de-3dc2c21a5b27 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:01.271936 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b1dfe4d9-8eab-4200-84de-3dc2c21a5b27 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:01.288170 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-b1dfe4d9-8eab-4200-84de-3dc2c21a5b27 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] HTTP exception thrown: Instance 19726b62-06f4-4547-9021-b58c9571f183 could not be found. Jun 08 02:13:01.290029 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b1dfe4d9-8eab-4200-84de-3dc2c21a5b27 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Request method failure captured: Jun 08 02:13:01.290029 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 HTTP/1.1 Jun 08 02:13:01.290029 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept: application/json Jun 08 02:13:01.290029 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jun 08 02:13:01.290029 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Connection: close Jun 08 02:13:01.290029 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jun 08 02:13:01.290029 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jun 08 02:13:01.290029 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Host: 10.222.0.20 Jun 08 02:13:01.290029 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jun 08 02:13:01.290029 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jun 08 02:13:01.290029 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABioAQ5Q-kUAsXXvLlpD_vYTS_7Cpa1UAreb9KfSGFfqnpepRbFXxhuJ2XB5BrVclykIXGPkhYy5vkv1P-6xYsW7EcD9VCdOVs5ad6zVygMxRb19EBZmRfA7p-4qsREHksD7Kz2ms_5tPzTz35DUlR3oX6FYY6jgHb8NUH7WRjcGG89vsI Jun 08 02:13:01.290029 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jun 08 02:13:01.290029 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jun 08 02:13:01.290029 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jun 08 02:13:01.290029 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jun 08 02:13:01.290029 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Openstack-Nova-Api-Version: 2.20 Jun 08 02:13:01.290029 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jun 08 02:13:01.290029 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jun 08 02:13:01.290029 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Id: 7daf0f9fd80c464ca4fbf7f2e19fccbd Jun 08 02:13:01.290029 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-248114998 Jun 08 02:13:01.290029 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jun 08 02:13:01.290029 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jun 08 02:13:01.291620 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7daf0f9fd80c464ca4fbf7f2e19fccbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7daf0f9fd80c464ca4fbf7f2e19fccbd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7daf0f9fd80c464ca4fbf7f2e19fccbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7daf0f9fd80c464ca4fbf7f2e19fccbd"}]}] Jun 08 02:13:01.291620 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-AttachVolumeShelveTestJSON-248114998 Jun 08 02:13:01.291620 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 7daf0f9fd80c464ca4fbf7f2e19fccbd Jun 08 02:13:01.291620 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-248114998 Jun 08 02:13:01.291620 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User: tempest-AttachVolumeShelveTestJSON-248114998-project Jun 08 02:13:01.291620 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jun 08 02:13:01.291620 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jun 08 02:13:01.291620 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Id: a3b4081bebe74c839f5aa214275210b4 Jun 08 02:13:01.291620 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-AttachVolumeShelveTestJSON-248114998-project Jun 08 02:13:01.291620 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: method: > Jun 08 02:13:01.291620 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: exception: Instance 19726b62-06f4-4547-9021-b58c9571f183 could not be found. Jun 08 02:13:01.291620 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: action_args: {'id': '19726b62-06f4-4547-9021-b58c9571f183'} Jun 08 02:13:01.292507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:13:01.292507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:13:01.292507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:13:01.292507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:13:01.292507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:13:01.292507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:13:01.292507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:13:01.292507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:13:01.292507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:13:01.292507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:13:01.292507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19726b62-06f4-4547-9021-b58c9571f183 could not be found. Jun 08 02:13:01.292507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:13:01.292507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:13:01.292507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:13:01.292507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:13:01.292507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:13:01.292507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:13:01.292507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:13:01.292507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:13:01.292507 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:13:01.293895 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:13:01.293895 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 02:13:01.293895 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 02:13:01.293895 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:13:01.293895 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:13:01.293895 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:13:01.293895 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:13:01.293895 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19726b62-06f4-4547-9021-b58c9571f183 could not be found. Jun 08 02:13:01.293895 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:13:01.293895 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:13:01.293895 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:13:01.293895 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:13:01.293895 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:13:01.293895 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:13:01.293895 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:13:01.293895 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:13:01.293895 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19726b62-06f4-4547-9021-b58c9571f183 could not be found. Jun 08 02:13:01.293895 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:13:01.297150 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b1dfe4d9-8eab-4200-84de-3dc2c21a5b27 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Returning 404 to user: Instance 19726b62-06f4-4547-9021-b58c9571f183 could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:13:01.298148 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-b1dfe4d9-8eab-4200-84de-3dc2c21a5b27 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183" status: 404 len: 111 microversion: 2.20 time: 0.054001 Jun 08 02:13:01.302564 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 405/797] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:13:01 2022] GET /compute/v2.1/servers/19726b62-06f4-4547-9021-b58c9571f183 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 08 02:13:02.473189 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-00b7c7ce-a820-4362-8747-5b454c3529c8 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:13:02.473706 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-00b7c7ce-a820-4362-8747-5b454c3529c8 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:13:02.480108 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-00b7c7ce-a820-4362-8747-5b454c3529c8 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:02.480588 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-00b7c7ce-a820-4362-8747-5b454c3529c8 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:02.481343 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-00b7c7ce-a820-4362-8747-5b454c3529c8 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:02.482346 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-00b7c7ce-a820-4362-8747-5b454c3529c8 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:02.495635 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-00b7c7ce-a820-4362-8747-5b454c3529c8 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] HTTP exception thrown: Instance b7944f2e-2294-4a69-bd4e-d51f50e73e56 could not be found. Jun 08 02:13:02.497207 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-00b7c7ce-a820-4362-8747-5b454c3529c8 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Request method failure captured: Jun 08 02:13:02.497207 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: request: DELETE /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 HTTP/1.1 Jun 08 02:13:02.497207 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept: application/json Jun 08 02:13:02.497207 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jun 08 02:13:02.497207 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Connection: close Jun 08 02:13:02.497207 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jun 08 02:13:02.497207 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jun 08 02:13:02.497207 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Host: 10.222.0.20 Jun 08 02:13:02.497207 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jun 08 02:13:02.497207 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jun 08 02:13:02.497207 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABioAQ5Q-kUAsXXvLlpD_vYTS_7Cpa1UAreb9KfSGFfqnpepRbFXxhuJ2XB5BrVclykIXGPkhYy5vkv1P-6xYsW7EcD9VCdOVs5ad6zVygMxRb19EBZmRfA7p-4qsREHksD7Kz2ms_5tPzTz35DUlR3oX6FYY6jgHb8NUH7WRjcGG89vsI Jun 08 02:13:02.497207 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jun 08 02:13:02.497207 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jun 08 02:13:02.497207 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jun 08 02:13:02.497207 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jun 08 02:13:02.497207 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Openstack-Nova-Api-Version: 2.20 Jun 08 02:13:02.497207 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jun 08 02:13:02.497207 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jun 08 02:13:02.497207 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Id: 7daf0f9fd80c464ca4fbf7f2e19fccbd Jun 08 02:13:02.497207 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-248114998 Jun 08 02:13:02.497207 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jun 08 02:13:02.497207 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jun 08 02:13:02.498908 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7daf0f9fd80c464ca4fbf7f2e19fccbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7daf0f9fd80c464ca4fbf7f2e19fccbd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7daf0f9fd80c464ca4fbf7f2e19fccbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7daf0f9fd80c464ca4fbf7f2e19fccbd"}]}] Jun 08 02:13:02.498908 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeShelveTestJSON-248114998 Jun 08 02:13:02.498908 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 7daf0f9fd80c464ca4fbf7f2e19fccbd Jun 08 02:13:02.498908 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-248114998 Jun 08 02:13:02.498908 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeShelveTestJSON-248114998-project Jun 08 02:13:02.498908 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jun 08 02:13:02.498908 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jun 08 02:13:02.498908 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Id: a3b4081bebe74c839f5aa214275210b4 Jun 08 02:13:02.498908 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeShelveTestJSON-248114998-project Jun 08 02:13:02.498908 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: method: > Jun 08 02:13:02.498908 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: exception: Instance b7944f2e-2294-4a69-bd4e-d51f50e73e56 could not be found. Jun 08 02:13:02.498908 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: action_args: {'id': 'b7944f2e-2294-4a69-bd4e-d51f50e73e56'} Jun 08 02:13:02.500119 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:13:02.500119 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:13:02.500119 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:13:02.500119 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:13:02.500119 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:13:02.500119 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:13:02.500119 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:13:02.500119 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:13:02.500119 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:13:02.500119 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:13:02.500119 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7944f2e-2294-4a69-bd4e-d51f50e73e56 could not be found. Jun 08 02:13:02.500119 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:13:02.500119 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:13:02.500119 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:13:02.500119 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:13:02.500119 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:13:02.500119 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:13:02.500119 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:13:02.500119 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:13:02.500119 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:13:02.501384 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:13:02.501384 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 08 02:13:02.501384 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 08 02:13:02.501384 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 08 02:13:02.501384 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 08 02:13:02.501384 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:13:02.501384 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:13:02.501384 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:13:02.501384 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:13:02.501384 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7944f2e-2294-4a69-bd4e-d51f50e73e56 could not be found. Jun 08 02:13:02.501384 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:13:02.501384 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:13:02.501384 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:13:02.501384 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:13:02.501384 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:13:02.501384 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:13:02.501384 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:13:02.501384 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:13:02.501384 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7944f2e-2294-4a69-bd4e-d51f50e73e56 could not be found. Jun 08 02:13:02.501384 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:13:02.503205 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-00b7c7ce-a820-4362-8747-5b454c3529c8 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Returning 404 to user: Instance b7944f2e-2294-4a69-bd4e-d51f50e73e56 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:13:02.503205 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-00b7c7ce-a820-4362-8747-5b454c3529c8 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 404 len: 111 microversion: 2.20 time: 0.029379 Jun 08 02:13:02.503205 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 393/798] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Jun 8 02:13:02 2022] DELETE /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 08 02:13:02.509213 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-be6dd264-670f-44ea-af8d-910268185347 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:13:02.509884 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-be6dd264-670f-44ea-af8d-910268185347 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] [instance: b7944f2e-2294-4a69-bd4e-d51f50e73e56] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:13:02.517122 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-be6dd264-670f-44ea-af8d-910268185347 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:02.517569 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-be6dd264-670f-44ea-af8d-910268185347 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:02.518618 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-be6dd264-670f-44ea-af8d-910268185347 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:02.519051 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-be6dd264-670f-44ea-af8d-910268185347 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:02.533377 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-be6dd264-670f-44ea-af8d-910268185347 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] HTTP exception thrown: Instance b7944f2e-2294-4a69-bd4e-d51f50e73e56 could not be found. Jun 08 02:13:02.535156 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-be6dd264-670f-44ea-af8d-910268185347 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Request method failure captured: Jun 08 02:13:02.535156 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 HTTP/1.1 Jun 08 02:13:02.535156 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept: application/json Jun 08 02:13:02.535156 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jun 08 02:13:02.535156 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Connection: close Jun 08 02:13:02.535156 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jun 08 02:13:02.535156 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jun 08 02:13:02.535156 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Host: 10.222.0.20 Jun 08 02:13:02.535156 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jun 08 02:13:02.535156 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jun 08 02:13:02.535156 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABioAQ5Q-kUAsXXvLlpD_vYTS_7Cpa1UAreb9KfSGFfqnpepRbFXxhuJ2XB5BrVclykIXGPkhYy5vkv1P-6xYsW7EcD9VCdOVs5ad6zVygMxRb19EBZmRfA7p-4qsREHksD7Kz2ms_5tPzTz35DUlR3oX6FYY6jgHb8NUH7WRjcGG89vsI Jun 08 02:13:02.535156 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jun 08 02:13:02.535156 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jun 08 02:13:02.535156 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jun 08 02:13:02.535156 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jun 08 02:13:02.535156 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Openstack-Nova-Api-Version: 2.20 Jun 08 02:13:02.535156 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jun 08 02:13:02.535156 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jun 08 02:13:02.535156 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Id: 7daf0f9fd80c464ca4fbf7f2e19fccbd Jun 08 02:13:02.535156 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-248114998 Jun 08 02:13:02.535156 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jun 08 02:13:02.535156 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jun 08 02:13:02.536851 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7daf0f9fd80c464ca4fbf7f2e19fccbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7daf0f9fd80c464ca4fbf7f2e19fccbd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7daf0f9fd80c464ca4fbf7f2e19fccbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7daf0f9fd80c464ca4fbf7f2e19fccbd"}]}] Jun 08 02:13:02.536851 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-AttachVolumeShelveTestJSON-248114998 Jun 08 02:13:02.536851 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 7daf0f9fd80c464ca4fbf7f2e19fccbd Jun 08 02:13:02.536851 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-248114998 Jun 08 02:13:02.536851 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User: tempest-AttachVolumeShelveTestJSON-248114998-project Jun 08 02:13:02.536851 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jun 08 02:13:02.536851 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jun 08 02:13:02.536851 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Id: a3b4081bebe74c839f5aa214275210b4 Jun 08 02:13:02.536851 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-AttachVolumeShelveTestJSON-248114998-project Jun 08 02:13:02.536851 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: method: > Jun 08 02:13:02.536851 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: exception: Instance b7944f2e-2294-4a69-bd4e-d51f50e73e56 could not be found. Jun 08 02:13:02.536851 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: action_args: {'id': 'b7944f2e-2294-4a69-bd4e-d51f50e73e56'} Jun 08 02:13:02.537616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:13:02.537616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:13:02.537616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:13:02.537616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:13:02.537616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:13:02.537616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:13:02.537616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:13:02.537616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:13:02.537616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:13:02.537616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:13:02.537616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7944f2e-2294-4a69-bd4e-d51f50e73e56 could not be found. Jun 08 02:13:02.537616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:13:02.537616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:13:02.537616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:13:02.537616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:13:02.537616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:13:02.537616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:13:02.537616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:13:02.537616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:13:02.537616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:13:02.538805 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:13:02.538805 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 02:13:02.538805 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 02:13:02.538805 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:13:02.538805 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:13:02.538805 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:13:02.538805 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:13:02.538805 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7944f2e-2294-4a69-bd4e-d51f50e73e56 could not be found. Jun 08 02:13:02.538805 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:13:02.538805 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:13:02.538805 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:13:02.538805 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:13:02.538805 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:13:02.538805 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:13:02.538805 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:13:02.538805 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:13:02.538805 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7944f2e-2294-4a69-bd4e-d51f50e73e56 could not be found. Jun 08 02:13:02.538805 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:13:02.539925 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-be6dd264-670f-44ea-af8d-910268185347 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] Returning 404 to user: Instance b7944f2e-2294-4a69-bd4e-d51f50e73e56 could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:13:02.539925 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-be6dd264-670f-44ea-af8d-910268185347 tempest-AttachVolumeShelveTestJSON-248114998 tempest-AttachVolumeShelveTestJSON-248114998-project] 10.222.0.20 "GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56" status: 404 len: 111 microversion: 2.20 time: 0.032001 Jun 08 02:13:02.539925 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 406/799] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jun 8 02:13:02 2022] GET /compute/v2.1/servers/b7944f2e-2294-4a69-bd4e-d51f50e73e56 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 08 02:13:09.356456 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-68195a5e-1c8a-4c23-b7d6-e2bcfd69fafb tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:13:09.357678 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-68195a5e-1c8a-4c23-b7d6-e2bcfd69fafb tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:13:09.364247 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-68195a5e-1c8a-4c23-b7d6-e2bcfd69fafb tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:09.364818 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-68195a5e-1c8a-4c23-b7d6-e2bcfd69fafb tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:09.365891 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-68195a5e-1c8a-4c23-b7d6-e2bcfd69fafb tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:09.366392 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-68195a5e-1c8a-4c23-b7d6-e2bcfd69fafb tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:09.470302 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-68195a5e-1c8a-4c23-b7d6-e2bcfd69fafb tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "POST /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f/action" status: 202 len: 0 microversion: 2.1 time: 0.114667 Jun 08 02:13:09.471021 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 394/800] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jun 8 02:13:09 2022] POST /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 02:13:09.481158 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-5da0870b-8d0a-40cf-9ab6-92f0d7d094d5 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:13:09.482644 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-5da0870b-8d0a-40cf-9ab6-92f0d7d094d5 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:13:09.491512 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5da0870b-8d0a-40cf-9ab6-92f0d7d094d5 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:09.492208 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5da0870b-8d0a-40cf-9ab6-92f0d7d094d5 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:09.493371 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5da0870b-8d0a-40cf-9ab6-92f0d7d094d5 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:09.494216 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5da0870b-8d0a-40cf-9ab6-92f0d7d094d5 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:10.262013 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-5da0870b-8d0a-40cf-9ab6-92f0d7d094d5 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:13:10.272601 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-5da0870b-8d0a-40cf-9ab6-92f0d7d094d5 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1752 microversion: 2.1 time: 0.796942 Jun 08 02:13:10.273513 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 407/801] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:13:09 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1752 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:13:11.295252 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-96e8eb44-95ab-4bf6-b460-4f5264517cf5 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:13:11.296210 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-96e8eb44-95ab-4bf6-b460-4f5264517cf5 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:13:11.305814 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-96e8eb44-95ab-4bf6-b460-4f5264517cf5 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:11.305814 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-96e8eb44-95ab-4bf6-b460-4f5264517cf5 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:11.305814 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-96e8eb44-95ab-4bf6-b460-4f5264517cf5 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:11.306083 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-96e8eb44-95ab-4bf6-b460-4f5264517cf5 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:11.679003 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-96e8eb44-95ab-4bf6-b460-4f5264517cf5 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:13:11.690569 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-96e8eb44-95ab-4bf6-b460-4f5264517cf5 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1757 microversion: 2.1 time: 0.401726 Jun 08 02:13:11.691827 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 395/802] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:13:11 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1757 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:13:12.535048 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-4ac04ec1-1a91-4a35-8c87-b85758dc47bf tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Action: 'create', calling method: .version_select at 0x7f836af438b0>, body: {"keypair": {"name": "tempest-keypair-997621325", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaT/zmYdK59X7ZsKvUCEtFz9E/RDJ4XZdl1bVqEm/9x+eaH8KDLhBsCb7AGlfDmgbBWx+XdME8hTuU+ucJHvh5rFPOYDujjkspF38ds3gxLBmIZNZBBNhqV0Q9In1HI4w=="}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:13:12.549416 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-4ac04ec1-1a91-4a35-8c87-b85758dc47bf tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Getting quotas for project 879e3eacb3bc4b69891677c86bbd5de3. Resources: {'key_pairs'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 02:13:12.553193 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-4ac04ec1-1a91-4a35-8c87-b85758dc47bf tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Getting quotas for user 92de4ab63f6447eabefe34f65c71d918 and project 879e3eacb3bc4b69891677c86bbd5de3. Resources: {'key_pairs'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 02:13:12.576010 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-4ac04ec1-1a91-4a35-8c87-b85758dc47bf tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.162293 Jun 08 02:13:12.576636 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 408/803] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jun 8 02:13:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:13:12.709386 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-bdc7a148-dfad-4b59-8ab8-390fc59de4ed tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:13:12.709984 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-bdc7a148-dfad-4b59-8ab8-390fc59de4ed tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:13:12.717805 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bdc7a148-dfad-4b59-8ab8-390fc59de4ed tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:12.718266 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bdc7a148-dfad-4b59-8ab8-390fc59de4ed tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:12.719289 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bdc7a148-dfad-4b59-8ab8-390fc59de4ed tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:12.719737 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bdc7a148-dfad-4b59-8ab8-390fc59de4ed tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:12.957666 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-bdc7a148-dfad-4b59-8ab8-390fc59de4ed tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:13:12.976180 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-bdc7a148-dfad-4b59-8ab8-390fc59de4ed tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1757 microversion: 2.1 time: 0.271157 Jun 08 02:13:12.977268 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 396/804] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:13:12 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1757 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:13:13.995391 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-9a16dd55-0644-474c-96ad-3c62ff98bebd tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:13:13.996794 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-9a16dd55-0644-474c-96ad-3c62ff98bebd tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:13:14.009800 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9a16dd55-0644-474c-96ad-3c62ff98bebd tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:14.010641 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9a16dd55-0644-474c-96ad-3c62ff98bebd tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:14.011598 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9a16dd55-0644-474c-96ad-3c62ff98bebd tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:14.012208 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9a16dd55-0644-474c-96ad-3c62ff98bebd tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:14.321762 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-9a16dd55-0644-474c-96ad-3c62ff98bebd tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:13:14.327186 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8da9269d-2e6d-4bc7-bb64-c7ef547852c6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-583859777", "imageRef": "e648e482-e374-429d-8152-a4a63797f314", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ace59b46-c184-42c4-a8ec-b505d053335a"}], "security_groups": [{"name": "tempest-securitygroup--1917158373"}], "key_name": "tempest-keypair-997621325", "user_data": "}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:13:14.339066 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-9a16dd55-0644-474c-96ad-3c62ff98bebd tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1757 microversion: 2.1 time: 0.348930 Jun 08 02:13:14.340031 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 409/805] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:13:13 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1757 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:13:14.458399 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.network.neutron [None req-8da9269d-2e6d-4bc7-bb64-c7ef547852c6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] validate_networks() for [('ace59b46-c184-42c4-a8ec-b505d053335a', None, None, None, None, None)] {{(pid=117938) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 02:13:14.965009 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-8da9269d-2e6d-4bc7-bb64-c7ef547852c6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Flavor limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 02:13:14.965434 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-8da9269d-2e6d-4bc7-bb64-c7ef547852c6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Image limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 02:13:14.966437 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-8da9269d-2e6d-4bc7-bb64-c7ef547852c6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Flavor pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 02:13:14.966845 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-8da9269d-2e6d-4bc7-bb64-c7ef547852c6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Image pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 02:13:14.967250 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-8da9269d-2e6d-4bc7-bb64-c7ef547852c6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 02:13:14.979673 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8da9269d-2e6d-4bc7-bb64-c7ef547852c6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:14.980382 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8da9269d-2e6d-4bc7-bb64-c7ef547852c6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:14.981411 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8da9269d-2e6d-4bc7-bb64-c7ef547852c6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:14.983505 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8da9269d-2e6d-4bc7-bb64-c7ef547852c6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:15.008010 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-8da9269d-2e6d-4bc7-bb64-c7ef547852c6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Getting quotas for project 879e3eacb3bc4b69891677c86bbd5de3. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 02:13:15.012234 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-8da9269d-2e6d-4bc7-bb64-c7ef547852c6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Getting quotas for user 92de4ab63f6447eabefe34f65c71d918 and project 879e3eacb3bc4b69891677c86bbd5de3. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 02:13:15.026193 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8da9269d-2e6d-4bc7-bb64-c7ef547852c6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Going to run 1 instances... {{(pid=117938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 02:13:15.029431 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8da9269d-2e6d-4bc7-bb64-c7ef547852c6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 78009a5e-d759-4faf-8ef4-fe4d5612a690] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e648e482-e374-429d-8152-a4a63797f314',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 02:13:15.086705 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8da9269d-2e6d-4bc7-bb64-c7ef547852c6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.771450 Jun 08 02:13:15.087794 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 397/806] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jun 8 02:13:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 08 02:13:15.101604 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-5a353ada-ff41-4c66-81e4-ba5acdd96ccf tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:13:15.104095 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-5a353ada-ff41-4c66-81e4-ba5acdd96ccf tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 78009a5e-d759-4faf-8ef4-fe4d5612a690] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:13:15.183291 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-5a353ada-ff41-4c66-81e4-ba5acdd96ccf tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:13:15.191055 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-5a353ada-ff41-4c66-81e4-ba5acdd96ccf tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690" status: 200 len: 1240 microversion: 2.1 time: 0.095085 Jun 08 02:13:15.192283 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 410/807] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:13:15 2022] GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690 => generated 1240 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:13:15.357498 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f13dd6b0-4ca1-49fa-a616-de4ec1d865d7 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:13:15.358585 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f13dd6b0-4ca1-49fa-a616-de4ec1d865d7 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:13:15.366828 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f13dd6b0-4ca1-49fa-a616-de4ec1d865d7 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:15.367463 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f13dd6b0-4ca1-49fa-a616-de4ec1d865d7 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:15.368594 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f13dd6b0-4ca1-49fa-a616-de4ec1d865d7 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:15.369126 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f13dd6b0-4ca1-49fa-a616-de4ec1d865d7 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:15.555348 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f13dd6b0-4ca1-49fa-a616-de4ec1d865d7 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:13:15.564765 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f13dd6b0-4ca1-49fa-a616-de4ec1d865d7 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1757 microversion: 2.1 time: 0.212274 Jun 08 02:13:15.576859 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 398/808] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:13:15 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1757 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:13:16.211175 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-cba1007d-25a8-4199-945d-3bc4c31701fd tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:13:16.211731 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-cba1007d-25a8-4199-945d-3bc4c31701fd tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 78009a5e-d759-4faf-8ef4-fe4d5612a690] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:13:16.218932 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cba1007d-25a8-4199-945d-3bc4c31701fd tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:16.219385 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cba1007d-25a8-4199-945d-3bc4c31701fd tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:16.220148 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cba1007d-25a8-4199-945d-3bc4c31701fd tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:16.220617 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cba1007d-25a8-4199-945d-3bc4c31701fd tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:16.292010 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-cba1007d-25a8-4199-945d-3bc4c31701fd tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:13:16.300211 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-cba1007d-25a8-4199-945d-3bc4c31701fd tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690" status: 200 len: 1300 microversion: 2.1 time: 0.092872 Jun 08 02:13:16.300805 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 411/809] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:13:16 2022] GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690 => generated 1300 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:13:16.583308 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c1a922e3-2525-4527-9e0d-23b046d21736 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:13:16.583958 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c1a922e3-2525-4527-9e0d-23b046d21736 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:13:16.594837 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c1a922e3-2525-4527-9e0d-23b046d21736 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:16.595606 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c1a922e3-2525-4527-9e0d-23b046d21736 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:16.596388 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c1a922e3-2525-4527-9e0d-23b046d21736 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:16.596861 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c1a922e3-2525-4527-9e0d-23b046d21736 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:16.831218 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c1a922e3-2525-4527-9e0d-23b046d21736 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:13:16.847409 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c1a922e3-2525-4527-9e0d-23b046d21736 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1757 microversion: 2.1 time: 0.268405 Jun 08 02:13:16.848178 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 399/810] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:13:16 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1757 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:13:17.317456 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e451ae5a-b066-4dea-b8fa-2aa6be940506 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:13:17.318694 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e451ae5a-b066-4dea-b8fa-2aa6be940506 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 78009a5e-d759-4faf-8ef4-fe4d5612a690] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:13:17.325527 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e451ae5a-b066-4dea-b8fa-2aa6be940506 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:17.326707 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e451ae5a-b066-4dea-b8fa-2aa6be940506 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:17.327927 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e451ae5a-b066-4dea-b8fa-2aa6be940506 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:17.328412 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e451ae5a-b066-4dea-b8fa-2aa6be940506 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:17.539973 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e451ae5a-b066-4dea-b8fa-2aa6be940506 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:13:17.548233 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e451ae5a-b066-4dea-b8fa-2aa6be940506 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690" status: 200 len: 1366 microversion: 2.1 time: 0.234875 Jun 08 02:13:17.548921 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 412/811] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:13:17 2022] GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:13:17.817711 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-7014f9be-c875-45ba-ad54-d505041ffc38 req-6c02cf80-40d1-4e9b-80bb-615117f02862 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78009a5e-d759-4faf-8ef4-fe4d5612a690", "tag": "4d3d34e3-e17d-4678-b0d8-343a5545ea95"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:13:17.849957 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-7014f9be-c875-45ba-ad54-d505041ffc38 req-6c02cf80-40d1-4e9b-80bb-615117f02862 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:17.850636 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-7014f9be-c875-45ba-ad54-d505041ffc38 req-6c02cf80-40d1-4e9b-80bb-615117f02862 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:17.855172 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:13:17.865977 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-7014f9be-c875-45ba-ad54-d505041ffc38 req-6c02cf80-40d1-4e9b-80bb-615117f02862 service nova] Creating event network-changed:4d3d34e3-e17d-4678-b0d8-343a5545ea95 for instance 78009a5e-d759-4faf-8ef4-fe4d5612a690 on hv-cinder-84506 Jun 08 02:13:17.866225 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-440cc0cb-8b7a-45fd-a950-d62d002e7e2c tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:13:17.866635 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-440cc0cb-8b7a-45fd-a950-d62d002e7e2c tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:13:17.871870 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-7014f9be-c875-45ba-ad54-d505041ffc38 req-6c02cf80-40d1-4e9b-80bb-615117f02862 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063189 Jun 08 02:13:17.878005 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-440cc0cb-8b7a-45fd-a950-d62d002e7e2c tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:17.878809 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-440cc0cb-8b7a-45fd-a950-d62d002e7e2c tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:17.881514 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 400/812] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:13:17.882270 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-440cc0cb-8b7a-45fd-a950-d62d002e7e2c tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:17.882719 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-440cc0cb-8b7a-45fd-a950-d62d002e7e2c tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:18.398127 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-440cc0cb-8b7a-45fd-a950-d62d002e7e2c tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:13:18.407606 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-440cc0cb-8b7a-45fd-a950-d62d002e7e2c tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1757 microversion: 2.1 time: 0.546518 Jun 08 02:13:18.408188 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 413/813] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:13:17 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1757 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:13:18.567097 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-87845319-5eb2-4dbb-8767-5c730a904527 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:13:18.567791 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-87845319-5eb2-4dbb-8767-5c730a904527 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 78009a5e-d759-4faf-8ef4-fe4d5612a690] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:13:18.575792 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-87845319-5eb2-4dbb-8767-5c730a904527 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:18.576148 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-87845319-5eb2-4dbb-8767-5c730a904527 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:18.576947 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-87845319-5eb2-4dbb-8767-5c730a904527 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:18.577386 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-87845319-5eb2-4dbb-8767-5c730a904527 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:18.715505 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-87845319-5eb2-4dbb-8767-5c730a904527 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:13:18.723247 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-87845319-5eb2-4dbb-8767-5c730a904527 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690" status: 200 len: 1366 microversion: 2.1 time: 0.160429 Jun 08 02:13:18.723794 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 401/814] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:13:18 2022] GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:13:19.426175 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-dc202998-36fa-4741-ac1c-f21eb18d15ab tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:13:19.426815 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-dc202998-36fa-4741-ac1c-f21eb18d15ab tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:13:19.433489 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-dc202998-36fa-4741-ac1c-f21eb18d15ab tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:19.433923 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-dc202998-36fa-4741-ac1c-f21eb18d15ab tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:19.434688 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-dc202998-36fa-4741-ac1c-f21eb18d15ab tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:19.435319 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-dc202998-36fa-4741-ac1c-f21eb18d15ab tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:19.673399 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-dc202998-36fa-4741-ac1c-f21eb18d15ab tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:13:19.682281 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-dc202998-36fa-4741-ac1c-f21eb18d15ab tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1757 microversion: 2.1 time: 0.260281 Jun 08 02:13:19.682786 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 414/815] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:13:19 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1757 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:13:19.741574 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-12447d60-2c49-4044-95ed-d0e7c0994191 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:13:19.742287 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-12447d60-2c49-4044-95ed-d0e7c0994191 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 78009a5e-d759-4faf-8ef4-fe4d5612a690] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:13:19.748938 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-12447d60-2c49-4044-95ed-d0e7c0994191 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:19.749516 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-12447d60-2c49-4044-95ed-d0e7c0994191 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:19.750461 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-12447d60-2c49-4044-95ed-d0e7c0994191 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:19.751118 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-12447d60-2c49-4044-95ed-d0e7c0994191 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:19.965434 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-12447d60-2c49-4044-95ed-d0e7c0994191 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:13:19.974021 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-12447d60-2c49-4044-95ed-d0e7c0994191 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690" status: 200 len: 1366 microversion: 2.1 time: 0.236197 Jun 08 02:13:19.975012 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 402/816] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:13:19 2022] GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:13:20.699245 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ca598bc1-e7e8-4bff-83ec-85b0685e2560 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:13:20.699883 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ca598bc1-e7e8-4bff-83ec-85b0685e2560 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:13:20.707615 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ca598bc1-e7e8-4bff-83ec-85b0685e2560 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:20.708058 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ca598bc1-e7e8-4bff-83ec-85b0685e2560 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:20.708857 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ca598bc1-e7e8-4bff-83ec-85b0685e2560 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:20.709288 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ca598bc1-e7e8-4bff-83ec-85b0685e2560 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:20.866722 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ca598bc1-e7e8-4bff-83ec-85b0685e2560 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:13:20.875123 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ca598bc1-e7e8-4bff-83ec-85b0685e2560 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1757 microversion: 2.1 time: 0.179706 Jun 08 02:13:20.875676 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 415/817] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:13:20 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:13:20.992363 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8000096c-2868-4c1e-91fd-bb2b51503496 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:13:20.993550 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8000096c-2868-4c1e-91fd-bb2b51503496 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 78009a5e-d759-4faf-8ef4-fe4d5612a690] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:13:21.001208 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8000096c-2868-4c1e-91fd-bb2b51503496 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:21.001653 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8000096c-2868-4c1e-91fd-bb2b51503496 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:21.002423 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8000096c-2868-4c1e-91fd-bb2b51503496 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:21.002861 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8000096c-2868-4c1e-91fd-bb2b51503496 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:21.132291 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8000096c-2868-4c1e-91fd-bb2b51503496 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:13:21.140457 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8000096c-2868-4c1e-91fd-bb2b51503496 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690" status: 200 len: 1366 microversion: 2.1 time: 0.152923 Jun 08 02:13:21.141029 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 403/818] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:13:20 2022] GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:13:21.891965 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-08f8616e-b9a4-490f-a2d9-0984a1c34043 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:13:21.892650 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-08f8616e-b9a4-490f-a2d9-0984a1c34043 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:13:21.899118 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-08f8616e-b9a4-490f-a2d9-0984a1c34043 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:21.899566 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-08f8616e-b9a4-490f-a2d9-0984a1c34043 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:21.900325 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-08f8616e-b9a4-490f-a2d9-0984a1c34043 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:21.900791 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-08f8616e-b9a4-490f-a2d9-0984a1c34043 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:22.058835 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-08f8616e-b9a4-490f-a2d9-0984a1c34043 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:13:22.067559 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-08f8616e-b9a4-490f-a2d9-0984a1c34043 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1757 microversion: 2.1 time: 0.179331 Jun 08 02:13:22.068132 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 416/819] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:13:21 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:13:22.159056 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e0f7978a-dd41-4302-8ae4-283d3731bccb tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:13:22.159906 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e0f7978a-dd41-4302-8ae4-283d3731bccb tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 78009a5e-d759-4faf-8ef4-fe4d5612a690] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:13:22.166352 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e0f7978a-dd41-4302-8ae4-283d3731bccb tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:22.166807 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e0f7978a-dd41-4302-8ae4-283d3731bccb tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:22.167576 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e0f7978a-dd41-4302-8ae4-283d3731bccb tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:22.168013 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e0f7978a-dd41-4302-8ae4-283d3731bccb tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:22.297822 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e0f7978a-dd41-4302-8ae4-283d3731bccb tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:13:22.305840 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e0f7978a-dd41-4302-8ae4-283d3731bccb tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690" status: 200 len: 1366 microversion: 2.1 time: 0.150457 Jun 08 02:13:22.306339 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 404/820] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:13:22 2022] GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:13:23.084999 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-de0a08fe-e5a3-4232-abd6-f3835814aad5 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:13:23.085614 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-de0a08fe-e5a3-4232-abd6-f3835814aad5 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:13:23.088070 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:13:23.094549 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-de0a08fe-e5a3-4232-abd6-f3835814aad5 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:23.094977 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-de0a08fe-e5a3-4232-abd6-f3835814aad5 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:23.095734 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-de0a08fe-e5a3-4232-abd6-f3835814aad5 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:23.096353 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-de0a08fe-e5a3-4232-abd6-f3835814aad5 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:23.099633 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=95 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:13:23.243770 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-de0a08fe-e5a3-4232-abd6-f3835814aad5 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:13:23.252692 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-de0a08fe-e5a3-4232-abd6-f3835814aad5 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1757 microversion: 2.1 time: 0.171501 Jun 08 02:13:23.253260 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 417/821] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:13:23 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:13:23.323074 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0686385a-53a6-4254-a47f-684ab7377538 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:13:23.323681 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0686385a-53a6-4254-a47f-684ab7377538 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 78009a5e-d759-4faf-8ef4-fe4d5612a690] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:13:23.327249 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:13:23.333304 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0686385a-53a6-4254-a47f-684ab7377538 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:23.333879 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0686385a-53a6-4254-a47f-684ab7377538 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:23.334637 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0686385a-53a6-4254-a47f-684ab7377538 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:23.335067 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0686385a-53a6-4254-a47f-684ab7377538 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:23.471725 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0686385a-53a6-4254-a47f-684ab7377538 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:13:23.479255 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0686385a-53a6-4254-a47f-684ab7377538 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690" status: 200 len: 1366 microversion: 2.1 time: 0.160111 Jun 08 02:13:23.479822 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 405/822] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:13:23 2022] GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:13:23.831827 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-3c9bb95b-e30f-4805-83aa-2d8a99914418 req-d9810899-d7dc-4198-85f8-b50a4d7411dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78009a5e-d759-4faf-8ef4-fe4d5612a690", "name": "network-vif-plugged", "status": "completed", "tag": "4d3d34e3-e17d-4678-b0d8-343a5545ea95"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:13:23.839806 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-3c9bb95b-e30f-4805-83aa-2d8a99914418 req-d9810899-d7dc-4198-85f8-b50a4d7411dd service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:23.840245 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-3c9bb95b-e30f-4805-83aa-2d8a99914418 req-d9810899-d7dc-4198-85f8-b50a4d7411dd service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:23.852064 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-3c9bb95b-e30f-4805-83aa-2d8a99914418 req-d9810899-d7dc-4198-85f8-b50a4d7411dd service nova] Creating event network-vif-plugged:4d3d34e3-e17d-4678-b0d8-343a5545ea95 for instance 78009a5e-d759-4faf-8ef4-fe4d5612a690 on hv-cinder-84506 Jun 08 02:13:23.857913 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-3c9bb95b-e30f-4805-83aa-2d8a99914418 req-d9810899-d7dc-4198-85f8-b50a4d7411dd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029114 Jun 08 02:13:23.858503 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 418/823] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:13:24.270224 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-76d4e1ad-6da0-45a8-aed2-0d29d4c28414 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:13:24.270828 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-76d4e1ad-6da0-45a8-aed2-0d29d4c28414 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:13:24.276845 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-76d4e1ad-6da0-45a8-aed2-0d29d4c28414 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:24.277283 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-76d4e1ad-6da0-45a8-aed2-0d29d4c28414 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:24.278029 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-76d4e1ad-6da0-45a8-aed2-0d29d4c28414 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:24.278457 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-76d4e1ad-6da0-45a8-aed2-0d29d4c28414 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:24.427213 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-76d4e1ad-6da0-45a8-aed2-0d29d4c28414 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:13:24.435678 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-76d4e1ad-6da0-45a8-aed2-0d29d4c28414 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1757 microversion: 2.1 time: 0.169313 Jun 08 02:13:24.436253 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 406/824] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:13:24 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:13:24.498950 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ee0304b0-b05e-4b3b-a572-96fc2d7ff1f5 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:13:24.499641 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ee0304b0-b05e-4b3b-a572-96fc2d7ff1f5 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 78009a5e-d759-4faf-8ef4-fe4d5612a690] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:13:24.505958 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ee0304b0-b05e-4b3b-a572-96fc2d7ff1f5 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:24.506405 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ee0304b0-b05e-4b3b-a572-96fc2d7ff1f5 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:24.507165 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ee0304b0-b05e-4b3b-a572-96fc2d7ff1f5 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:24.507631 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ee0304b0-b05e-4b3b-a572-96fc2d7ff1f5 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:24.640987 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ee0304b0-b05e-4b3b-a572-96fc2d7ff1f5 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:13:24.648232 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ee0304b0-b05e-4b3b-a572-96fc2d7ff1f5 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690" status: 200 len: 1366 microversion: 2.1 time: 0.154505 Jun 08 02:13:24.648819 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 419/825] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:13:24 2022] GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:13:25.453260 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-514104f2-d446-410b-b1f9-d5ac235a3445 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:13:25.453854 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-514104f2-d446-410b-b1f9-d5ac235a3445 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:13:25.456092 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:13:25.456875 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=6 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:13:25.464002 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-514104f2-d446-410b-b1f9-d5ac235a3445 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:25.464483 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-514104f2-d446-410b-b1f9-d5ac235a3445 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:25.465248 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-514104f2-d446-410b-b1f9-d5ac235a3445 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:25.465685 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-514104f2-d446-410b-b1f9-d5ac235a3445 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:25.620414 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-514104f2-d446-410b-b1f9-d5ac235a3445 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:13:25.628648 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-514104f2-d446-410b-b1f9-d5ac235a3445 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1757 microversion: 2.1 time: 0.179327 Jun 08 02:13:25.629319 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 407/826] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:13:25 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:13:25.665609 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-33dec55d-cbfd-493c-abe6-8eeba0150c86 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:13:25.666322 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-33dec55d-cbfd-493c-abe6-8eeba0150c86 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 78009a5e-d759-4faf-8ef4-fe4d5612a690] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:13:25.668308 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=6 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:13:25.674153 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-33dec55d-cbfd-493c-abe6-8eeba0150c86 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:25.674601 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-33dec55d-cbfd-493c-abe6-8eeba0150c86 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:25.675370 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-33dec55d-cbfd-493c-abe6-8eeba0150c86 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:25.676025 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-33dec55d-cbfd-493c-abe6-8eeba0150c86 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:25.811111 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-33dec55d-cbfd-493c-abe6-8eeba0150c86 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:13:25.818512 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-33dec55d-cbfd-493c-abe6-8eeba0150c86 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690" status: 200 len: 1556 microversion: 2.1 time: 0.156788 Jun 08 02:13:25.819070 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 420/827] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:13:25 2022] GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690 => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:13:25.834763 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7ea32484-25c6-4915-ab15-6c556d418a08 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:13:25.835259 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7ea32484-25c6-4915-ab15-6c556d418a08 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 78009a5e-d759-4faf-8ef4-fe4d5612a690] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:13:25.841491 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7ea32484-25c6-4915-ab15-6c556d418a08 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:25.841949 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7ea32484-25c6-4915-ab15-6c556d418a08 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:25.842715 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7ea32484-25c6-4915-ab15-6c556d418a08 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:25.843154 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7ea32484-25c6-4915-ab15-6c556d418a08 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:25.918090 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7ea32484-25c6-4915-ab15-6c556d418a08 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087152 Jun 08 02:13:25.918716 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 408/828] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jun 8 02:13:25 2022] GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:13:26.645816 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f9319f04-10ef-4fad-871c-f6f492a9fcb8 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:13:26.646447 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f9319f04-10ef-4fad-871c-f6f492a9fcb8 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:13:26.652483 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f9319f04-10ef-4fad-871c-f6f492a9fcb8 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:26.652930 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f9319f04-10ef-4fad-871c-f6f492a9fcb8 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:26.654372 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f9319f04-10ef-4fad-871c-f6f492a9fcb8 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:26.654982 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f9319f04-10ef-4fad-871c-f6f492a9fcb8 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:26.911160 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f9319f04-10ef-4fad-871c-f6f492a9fcb8 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:13:26.920265 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f9319f04-10ef-4fad-871c-f6f492a9fcb8 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1757 microversion: 2.1 time: 0.278283 Jun 08 02:13:26.921036 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 421/829] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:13:26 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1757 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:13:26.927475 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-904fe929-2f54-418f-abfc-1d5e773c5d15 req-cdefb261-fc7a-4b3d-bc9a-476da2945192 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78009a5e-d759-4faf-8ef4-fe4d5612a690", "tag": "4d3d34e3-e17d-4678-b0d8-343a5545ea95"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:13:26.937837 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-904fe929-2f54-418f-abfc-1d5e773c5d15 req-cdefb261-fc7a-4b3d-bc9a-476da2945192 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:26.938280 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-904fe929-2f54-418f-abfc-1d5e773c5d15 req-cdefb261-fc7a-4b3d-bc9a-476da2945192 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:26.949386 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-904fe929-2f54-418f-abfc-1d5e773c5d15 req-cdefb261-fc7a-4b3d-bc9a-476da2945192 service nova] Creating event network-changed:4d3d34e3-e17d-4678-b0d8-343a5545ea95 for instance 78009a5e-d759-4faf-8ef4-fe4d5612a690 on hv-cinder-84506 Jun 08 02:13:26.955505 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-904fe929-2f54-418f-abfc-1d5e773c5d15 req-cdefb261-fc7a-4b3d-bc9a-476da2945192 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032938 Jun 08 02:13:26.956214 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 409/830] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:13:27.938785 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-905e0370-3827-4c8f-a342-ad585efc4bdd tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:13:27.939406 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-905e0370-3827-4c8f-a342-ad585efc4bdd tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:13:27.948135 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-905e0370-3827-4c8f-a342-ad585efc4bdd tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:27.949083 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-905e0370-3827-4c8f-a342-ad585efc4bdd tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:27.950214 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-905e0370-3827-4c8f-a342-ad585efc4bdd tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:13:27.950298 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-905e0370-3827-4c8f-a342-ad585efc4bdd tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:13:28.383245 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-905e0370-3827-4c8f-a342-ad585efc4bdd tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:13:28.392363 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-905e0370-3827-4c8f-a342-ad585efc4bdd tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1760 microversion: 2.1 time: 0.458797 Jun 08 02:13:28.393223 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 422/831] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:13:27 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1760 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:14:03.026506 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-db504388-26c9-48e2-833a-46b1bdf6b9e5 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:14:03.027079 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-db504388-26c9-48e2-833a-46b1bdf6b9e5 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 78009a5e-d759-4faf-8ef4-fe4d5612a690] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:14:03.029344 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=9 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:14:03.029980 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=48 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:14:03.036763 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-db504388-26c9-48e2-833a-46b1bdf6b9e5 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:03.037212 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-db504388-26c9-48e2-833a-46b1bdf6b9e5 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:03.037967 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-db504388-26c9-48e2-833a-46b1bdf6b9e5 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:03.038404 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-db504388-26c9-48e2-833a-46b1bdf6b9e5 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:03.060711 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-db504388-26c9-48e2-833a-46b1bdf6b9e5 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690/ips" status: 200 len: 150 microversion: 2.1 time: 0.038728 Jun 08 02:14:03.061239 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 410/832] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Jun 8 02:14:03 2022] GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:14:03.709917 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-90fa2f7b-5ea1-4d1c-b095-e2edb57824f1 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-622762087"}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:14:03.710495 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-90fa2f7b-5ea1-4d1c-b095-e2edb57824f1 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:14:03.712552 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=11 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:14:03.713183 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=31 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:14:03.719831 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-90fa2f7b-5ea1-4d1c-b095-e2edb57824f1 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:03.720275 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-90fa2f7b-5ea1-4d1c-b095-e2edb57824f1 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:03.721062 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-90fa2f7b-5ea1-4d1c-b095-e2edb57824f1 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:03.721490 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-90fa2f7b-5ea1-4d1c-b095-e2edb57824f1 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:03.862350 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.network.security_group_api [None req-90fa2f7b-5ea1-4d1c-b095-e2edb57824f1 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Removing security group 49f602e6-cd7d-4297-b234-3cdf7556d07e from port 906aaccc-01a6-40cf-a960-5f798d175167 Jun 08 02:14:04.221539 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-90fa2f7b-5ea1-4d1c-b095-e2edb57824f1 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "POST /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f/action" status: 202 len: 0 microversion: 2.1 time: 0.515441 Jun 08 02:14:04.225301 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 423/833] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jun 8 02:14:03 2022] POST /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f/action => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 02:14:04.231824 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-0f06771f-74e0-4915-9a88-f759c930f6de req-10424c0f-f4b7-47fc-a621-b3bd1460bff9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b532af5d-7b14-4644-add7-8b716f81871f", "tag": "906aaccc-01a6-40cf-a960-5f798d175167"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:14:04.245548 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-0f06771f-74e0-4915-9a88-f759c930f6de req-10424c0f-f4b7-47fc-a621-b3bd1460bff9 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:04.246327 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-0f06771f-74e0-4915-9a88-f759c930f6de req-10424c0f-f4b7-47fc-a621-b3bd1460bff9 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:04.264501 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-0f06771f-74e0-4915-9a88-f759c930f6de req-10424c0f-f4b7-47fc-a621-b3bd1460bff9 service nova] Creating event network-changed:906aaccc-01a6-40cf-a960-5f798d175167 for instance b532af5d-7b14-4644-add7-8b716f81871f on hv-cinder-84506 Jun 08 02:14:04.270626 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-0f06771f-74e0-4915-9a88-f759c930f6de req-10424c0f-f4b7-47fc-a621-b3bd1460bff9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042334 Jun 08 02:14:04.274490 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 411/834] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:14:04.430519 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a1f952d5-349b-4723-b6a0-b9c477f5e630 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5bb933a-8fcd-4ba0-82c9-75d68bc13d64"}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:14:04.431664 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a1f952d5-349b-4723-b6a0-b9c477f5e630 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 78009a5e-d759-4faf-8ef4-fe4d5612a690] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:14:04.442169 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a1f952d5-349b-4723-b6a0-b9c477f5e630 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:04.442995 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a1f952d5-349b-4723-b6a0-b9c477f5e630 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:04.444030 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a1f952d5-349b-4723-b6a0-b9c477f5e630 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:04.449193 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a1f952d5-349b-4723-b6a0-b9c477f5e630 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:04.770092 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a1f952d5-349b-4723-b6a0-b9c477f5e630 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "POST /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.344173 Jun 08 02:14:04.775526 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 424/835] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jun 8 02:14:04 2022] POST /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690/os-volume_attachments => generated 194 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:14:05.565143 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e0190164-c85a-4d43-81d0-b5cdd0aa1be5 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:14:05.565725 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e0190164-c85a-4d43-81d0-b5cdd0aa1be5 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:14:05.572296 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e0190164-c85a-4d43-81d0-b5cdd0aa1be5 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:05.572850 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e0190164-c85a-4d43-81d0-b5cdd0aa1be5 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:05.573673 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e0190164-c85a-4d43-81d0-b5cdd0aa1be5 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:05.574205 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e0190164-c85a-4d43-81d0-b5cdd0aa1be5 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:05.574335 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-8bb7ea04-cca1-48d2-afb8-f13f70cc62b3 req-c6237fa8-6804-485b-8d9b-c30766a57a33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b532af5d-7b14-4644-add7-8b716f81871f", "tag": "906aaccc-01a6-40cf-a960-5f798d175167"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:14:05.583619 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-8bb7ea04-cca1-48d2-afb8-f13f70cc62b3 req-c6237fa8-6804-485b-8d9b-c30766a57a33 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:05.584064 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-8bb7ea04-cca1-48d2-afb8-f13f70cc62b3 req-c6237fa8-6804-485b-8d9b-c30766a57a33 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:05.595628 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-8bb7ea04-cca1-48d2-afb8-f13f70cc62b3 req-c6237fa8-6804-485b-8d9b-c30766a57a33 service nova] Creating event network-changed:906aaccc-01a6-40cf-a960-5f798d175167 for instance b532af5d-7b14-4644-add7-8b716f81871f on hv-cinder-84506 Jun 08 02:14:05.600449 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-8bb7ea04-cca1-48d2-afb8-f13f70cc62b3 req-c6237fa8-6804-485b-8d9b-c30766a57a33 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030587 Jun 08 02:14:05.601037 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 425/836] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:14:05.663863 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-e0190164-c85a-4d43-81d0-b5cdd0aa1be5 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lazy-loading 'services' on Instance uuid b532af5d-7b14-4644-add7-8b716f81871f {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 02:14:05.743062 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e0190164-c85a-4d43-81d0-b5cdd0aa1be5 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f/os-volume_attachments/ce3193f2-8611-429c-82ea-7c9e9d401991" status: 202 len: 0 microversion: 2.1 time: 0.182335 Jun 08 02:14:05.747423 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 412/837] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jun 8 02:14:05 2022] DELETE /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f/os-volume_attachments/ce3193f2-8611-429c-82ea-7c9e9d401991 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 02:14:05.756008 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-87fbd781-9432-4959-9860-c4217e5160bf tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:14:05.757266 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-87fbd781-9432-4959-9860-c4217e5160bf tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:14:05.767420 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-87fbd781-9432-4959-9860-c4217e5160bf tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:05.768413 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-87fbd781-9432-4959-9860-c4217e5160bf tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:05.769424 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-87fbd781-9432-4959-9860-c4217e5160bf tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:05.770531 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-87fbd781-9432-4959-9860-c4217e5160bf tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:05.813066 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-87fbd781-9432-4959-9860-c4217e5160bf tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062561 Jun 08 02:14:05.813633 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 426/838] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jun 8 02:14:05 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 02:14:06.825822 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d431ddd0-7db6-478e-bf60-5c7c10ae2ad1 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:14:06.826888 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d431ddd0-7db6-478e-bf60-5c7c10ae2ad1 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:14:06.833484 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d431ddd0-7db6-478e-bf60-5c7c10ae2ad1 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:06.834158 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d431ddd0-7db6-478e-bf60-5c7c10ae2ad1 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:06.834998 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d431ddd0-7db6-478e-bf60-5c7c10ae2ad1 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:06.835439 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d431ddd0-7db6-478e-bf60-5c7c10ae2ad1 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:06.866130 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d431ddd0-7db6-478e-bf60-5c7c10ae2ad1 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045092 Jun 08 02:14:06.866685 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 413/839] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jun 8 02:14:06 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:14:07.878666 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-679a1ced-0f55-484b-a259-0ea375963095 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:14:07.879612 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-679a1ced-0f55-484b-a259-0ea375963095 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:14:07.886367 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-679a1ced-0f55-484b-a259-0ea375963095 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:07.886804 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-679a1ced-0f55-484b-a259-0ea375963095 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:07.887563 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-679a1ced-0f55-484b-a259-0ea375963095 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:07.887989 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-679a1ced-0f55-484b-a259-0ea375963095 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:07.918902 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-679a1ced-0f55-484b-a259-0ea375963095 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044970 Jun 08 02:14:07.919454 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 427/840] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jun 8 02:14:07 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 02:14:08.931166 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a4819f67-80ec-49c7-b88f-7bb78c9cf213 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:14:08.932077 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a4819f67-80ec-49c7-b88f-7bb78c9cf213 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:14:08.939644 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a4819f67-80ec-49c7-b88f-7bb78c9cf213 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:08.940088 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a4819f67-80ec-49c7-b88f-7bb78c9cf213 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:08.940887 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a4819f67-80ec-49c7-b88f-7bb78c9cf213 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:08.941326 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a4819f67-80ec-49c7-b88f-7bb78c9cf213 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:08.969645 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a4819f67-80ec-49c7-b88f-7bb78c9cf213 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042443 Jun 08 02:14:08.970177 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 414/841] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jun 8 02:14:08 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 02:14:09.982626 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-9904cbf8-401e-481f-a4a3-9e1bb7dcb64b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:14:09.983556 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-9904cbf8-401e-481f-a4a3-9e1bb7dcb64b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:14:09.990345 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9904cbf8-401e-481f-a4a3-9e1bb7dcb64b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:09.990795 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9904cbf8-401e-481f-a4a3-9e1bb7dcb64b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:09.991557 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9904cbf8-401e-481f-a4a3-9e1bb7dcb64b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:09.991996 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9904cbf8-401e-481f-a4a3-9e1bb7dcb64b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:10.020003 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-9904cbf8-401e-481f-a4a3-9e1bb7dcb64b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041350 Jun 08 02:14:10.020573 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 428/842] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jun 8 02:14:09 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:14:11.031238 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c9dfba9e-53a6-48a3-ad08-972747dd1c43 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:14:11.032253 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c9dfba9e-53a6-48a3-ad08-972747dd1c43 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:14:11.038934 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c9dfba9e-53a6-48a3-ad08-972747dd1c43 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:11.039379 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c9dfba9e-53a6-48a3-ad08-972747dd1c43 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:11.040138 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c9dfba9e-53a6-48a3-ad08-972747dd1c43 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:11.040605 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c9dfba9e-53a6-48a3-ad08-972747dd1c43 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:11.070085 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c9dfba9e-53a6-48a3-ad08-972747dd1c43 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042743 Jun 08 02:14:11.070576 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 415/843] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jun 8 02:14:11 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:14:12.081710 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e6248c00-180e-4630-808b-cb8d76c5ac8c tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:14:12.082622 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e6248c00-180e-4630-808b-cb8d76c5ac8c tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:14:12.089041 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e6248c00-180e-4630-808b-cb8d76c5ac8c tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:12.089486 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e6248c00-180e-4630-808b-cb8d76c5ac8c tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:12.090271 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e6248c00-180e-4630-808b-cb8d76c5ac8c tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:12.090702 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e6248c00-180e-4630-808b-cb8d76c5ac8c tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:12.118746 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e6248c00-180e-4630-808b-cb8d76c5ac8c tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041162 Jun 08 02:14:12.119287 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 429/844] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jun 8 02:14:12 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 08 02:14:12.129142 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5aa8e780-a93f-4e47-bb6a-3d728b858670 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:14:12.129658 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5aa8e780-a93f-4e47-bb6a-3d728b858670 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:14:12.136006 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5aa8e780-a93f-4e47-bb6a-3d728b858670 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:12.136501 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5aa8e780-a93f-4e47-bb6a-3d728b858670 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:12.137252 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5aa8e780-a93f-4e47-bb6a-3d728b858670 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:12.137680 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5aa8e780-a93f-4e47-bb6a-3d728b858670 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:12.214383 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-5aa8e780-a93f-4e47-bb6a-3d728b858670 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] HTTP exception thrown: Instance b532af5d-7b14-4644-add7-8b716f81871f is not attached to volume ce3193f2-8611-429c-82ea-7c9e9d401991 Jun 08 02:14:12.219606 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5aa8e780-a93f-4e47-bb6a-3d728b858670 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Request method failure captured: Jun 08 02:14:12.219606 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: request: DELETE /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f/os-volume_attachments/ce3193f2-8611-429c-82ea-7c9e9d401991 HTTP/1.1 Jun 08 02:14:12.219606 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept: application/json Jun 08 02:14:12.219606 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jun 08 02:14:12.219606 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Connection: close Jun 08 02:14:12.219606 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jun 08 02:14:12.219606 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jun 08 02:14:12.219606 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Host: 10.222.0.20 Jun 08 02:14:12.219606 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jun 08 02:14:12.219606 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jun 08 02:14:12.219606 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABioAVhhHQHs18KmPAUcBzzRv5rLicGngJGENFBO_x_gxHkgmhlR7AbcRLGP_SCiKtTFpm0knAybwcZJygcLlmOmk7my6NtLcKTlSpqfqG3vw0mASmg_cYiMOwIZwvI1S3jKPvYNDULbMjg7V3Cp7qUFaA5ayXs-O5EiwsTfnv17LOHlAI Jun 08 02:14:12.219606 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jun 08 02:14:12.219606 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jun 08 02:14:12.219606 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jun 08 02:14:12.219606 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jun 08 02:14:12.219606 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jun 08 02:14:12.219606 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jun 08 02:14:12.219606 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Id: 3b0724451ec94fdbb4f2422c44245b53 Jun 08 02:14:12.219606 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-TestMinimumBasicScenario-870826201 Jun 08 02:14:12.219606 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jun 08 02:14:12.219606 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jun 08 02:14:12.221770 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b0724451ec94fdbb4f2422c44245b53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3b0724451ec94fdbb4f2422c44245b53", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3b0724451ec94fdbb4f2422c44245b53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b0724451ec94fdbb4f2422c44245b53"}]}] Jun 08 02:14:12.221770 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-TestMinimumBasicScenario-870826201 Jun 08 02:14:12.221770 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 3b0724451ec94fdbb4f2422c44245b53 Jun 08 02:14:12.221770 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-TestMinimumBasicScenario-870826201 Jun 08 02:14:12.221770 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User: tempest-TestMinimumBasicScenario-870826201-project Jun 08 02:14:12.221770 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jun 08 02:14:12.221770 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jun 08 02:14:12.221770 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Id: 2f0ae440fa644f1296d2b474c5335ffc Jun 08 02:14:12.221770 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-TestMinimumBasicScenario-870826201-project Jun 08 02:14:12.221770 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: method: > Jun 08 02:14:12.221770 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: exception: Instance b532af5d-7b14-4644-add7-8b716f81871f is not attached to volume ce3193f2-8611-429c-82ea-7c9e9d401991 Jun 08 02:14:12.222506 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: action_args: {'server_id': 'b532af5d-7b14-4644-add7-8b716f81871f', 'id': 'ce3193f2-8611-429c-82ea-7c9e9d401991'} Jun 08 02:14:12.222506 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:14:12.222506 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:14:12.222506 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 08 02:14:12.222506 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 08 02:14:12.222506 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 08 02:14:12.222506 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 08 02:14:12.222506 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 08 02:14:12.222506 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 08 02:14:12.222506 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ce3193f2-8611-429c-82ea-7c9e9d401991. Jun 08 02:14:12.222506 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:14:12.222506 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:14:12.222506 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:14:12.222506 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:14:12.222506 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:14:12.222506 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:14:12.222506 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:14:12.222506 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:14:12.222506 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:14:12.223741 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:14:12.223741 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 08 02:14:12.223741 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 08 02:14:12.223741 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b532af5d-7b14-4644-add7-8b716f81871f is not attached to volume ce3193f2-8611-429c-82ea-7c9e9d401991 Jun 08 02:14:12.223741 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:14:12.223741 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:14:12.223741 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:14:12.223741 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:14:12.223741 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:14:12.223741 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:14:12.223741 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:14:12.223741 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:14:12.223741 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b532af5d-7b14-4644-add7-8b716f81871f is not attached to volume ce3193f2-8611-429c-82ea-7c9e9d401991 Jun 08 02:14:12.223741 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:14:12.223741 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5aa8e780-a93f-4e47-bb6a-3d728b858670 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Returning 404 to user: Instance b532af5d-7b14-4644-add7-8b716f81871f is not attached to volume ce3193f2-8611-429c-82ea-7c9e9d401991 {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:14:12.224953 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5aa8e780-a93f-4e47-bb6a-3d728b858670 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f/os-volume_attachments/ce3193f2-8611-429c-82ea-7c9e9d401991" status: 404 len: 154 microversion: 2.1 time: 0.096898 Jun 08 02:14:12.224953 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 416/845] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jun 8 02:14:12 2022] DELETE /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f/os-volume_attachments/ce3193f2-8611-429c-82ea-7c9e9d401991 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 02:14:12.295867 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2c40a761-cec6-43b3-8b9c-05bd9e5366e3 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Action: 'create', calling method: .version_select at 0x7f837419cca0>, body: {"keypair": {"name": "tempest-keypair-1362479621", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORG3G7WPbTevqIgcEIfsjzaiV0OW6g+nuaSd/JDqyPnNuIVjOwRiaElPWsiFPjbICz3hSGVNe5s972ey2oHFZqW2LUcKNnkXkET0kmvNImkbXGeJ8rvxinejgrCZir+Ng=="}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:14:12.309553 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-2c40a761-cec6-43b3-8b9c-05bd9e5366e3 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Getting quotas for project 879e3eacb3bc4b69891677c86bbd5de3. Resources: {'key_pairs'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 02:14:12.315280 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-2c40a761-cec6-43b3-8b9c-05bd9e5366e3 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Getting quotas for user 92de4ab63f6447eabefe34f65c71d918 and project 879e3eacb3bc4b69891677c86bbd5de3. Resources: {'key_pairs'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 02:14:12.337367 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2c40a761-cec6-43b3-8b9c-05bd9e5366e3 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045225 Jun 08 02:14:12.337889 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 430/846] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jun 8 02:14:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 02:14:13.366990 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8aa5683e-49a9-4e61-9931-333512b41563 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:14:13.367494 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8aa5683e-49a9-4e61-9931-333512b41563 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:14:13.375607 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8aa5683e-49a9-4e61-9931-333512b41563 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:13.376063 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8aa5683e-49a9-4e61-9931-333512b41563 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:13.377135 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8aa5683e-49a9-4e61-9931-333512b41563 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:13.377569 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8aa5683e-49a9-4e61-9931-333512b41563 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:13.402222 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8aa5683e-49a9-4e61-9931-333512b41563 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Going to try to terminate instance {{(pid=117938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 02:14:13.480771 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8aa5683e-49a9-4e61-9931-333512b41563 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 204 len: 0 microversion: 2.1 time: 0.120839 Jun 08 02:14:13.481549 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 417/847] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jun 8 02:14:13 2022] DELETE /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 08 02:14:13.490363 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-424d215b-af3f-472e-9f5e-c856bfa39e62 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:14:13.490954 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-424d215b-af3f-472e-9f5e-c856bfa39e62 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:14:13.497958 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-424d215b-af3f-472e-9f5e-c856bfa39e62 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:13.498723 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-424d215b-af3f-472e-9f5e-c856bfa39e62 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:13.499955 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-424d215b-af3f-472e-9f5e-c856bfa39e62 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:13.500695 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-424d215b-af3f-472e-9f5e-c856bfa39e62 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:13.632984 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4ed13d5e-78ba-4323-9f80-cf6bf4388d49 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-679568252", "imageRef": "e648e482-e374-429d-8152-a4a63797f314", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ace59b46-c184-42c4-a8ec-b505d053335a"}], "security_groups": [{"name": "tempest-securitygroup--670178242"}], "key_name": "tempest-keypair-1362479621", "user_data": "}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:14:13.644708 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-424d215b-af3f-472e-9f5e-c856bfa39e62 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:14:13.652136 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-424d215b-af3f-472e-9f5e-c856bfa39e62 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1555 microversion: 2.1 time: 0.166556 Jun 08 02:14:13.653030 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 431/848] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:14:13 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:14:13.733557 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.network.neutron [None req-4ed13d5e-78ba-4323-9f80-cf6bf4388d49 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] validate_networks() for [('ace59b46-c184-42c4-a8ec-b505d053335a', None, None, None, None, None)] {{(pid=117938) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 02:14:14.098406 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-4ed13d5e-78ba-4323-9f80-cf6bf4388d49 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Flavor limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 02:14:14.098819 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-4ed13d5e-78ba-4323-9f80-cf6bf4388d49 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Image limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 02:14:14.099280 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-4ed13d5e-78ba-4323-9f80-cf6bf4388d49 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Flavor pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 02:14:14.099678 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-4ed13d5e-78ba-4323-9f80-cf6bf4388d49 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Image pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 02:14:14.100106 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-4ed13d5e-78ba-4323-9f80-cf6bf4388d49 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 02:14:14.108911 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4ed13d5e-78ba-4323-9f80-cf6bf4388d49 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:14.109349 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4ed13d5e-78ba-4323-9f80-cf6bf4388d49 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:14.110134 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4ed13d5e-78ba-4323-9f80-cf6bf4388d49 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:14.111216 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4ed13d5e-78ba-4323-9f80-cf6bf4388d49 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:14.127315 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-4ed13d5e-78ba-4323-9f80-cf6bf4388d49 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Getting quotas for project 879e3eacb3bc4b69891677c86bbd5de3. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 02:14:14.131225 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-4ed13d5e-78ba-4323-9f80-cf6bf4388d49 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Getting quotas for user 92de4ab63f6447eabefe34f65c71d918 and project 879e3eacb3bc4b69891677c86bbd5de3. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 02:14:14.142104 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4ed13d5e-78ba-4323-9f80-cf6bf4388d49 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Going to run 1 instances... {{(pid=117938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 02:14:14.144381 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4ed13d5e-78ba-4323-9f80-cf6bf4388d49 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 8870cf32-82de-4bee-98fd-08b49f529cf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e648e482-e374-429d-8152-a4a63797f314',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 02:14:14.191378 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4ed13d5e-78ba-4323-9f80-cf6bf4388d49 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.563201 Jun 08 02:14:14.192021 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 418/849] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jun 8 02:14:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 08 02:14:14.201933 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-925b2027-c1ba-4323-a9a2-b10760bff147 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:14:14.202547 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-925b2027-c1ba-4323-a9a2-b10760bff147 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 8870cf32-82de-4bee-98fd-08b49f529cf3] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:14:14.258104 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-925b2027-c1ba-4323-a9a2-b10760bff147 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:14:14.265420 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-925b2027-c1ba-4323-a9a2-b10760bff147 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3" status: 200 len: 1241 microversion: 2.1 time: 0.067290 Jun 08 02:14:14.265975 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 432/850] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:14:14 2022] GET /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:14:14.670106 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0e5e4544-5556-43be-ba18-bdf3e84f4009 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:14:14.670747 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0e5e4544-5556-43be-ba18-bdf3e84f4009 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:14:14.678031 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0e5e4544-5556-43be-ba18-bdf3e84f4009 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:14.678476 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0e5e4544-5556-43be-ba18-bdf3e84f4009 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:14.679232 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0e5e4544-5556-43be-ba18-bdf3e84f4009 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:14.679671 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0e5e4544-5556-43be-ba18-bdf3e84f4009 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:14.809628 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0e5e4544-5556-43be-ba18-bdf3e84f4009 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:14:14.817718 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0e5e4544-5556-43be-ba18-bdf3e84f4009 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1555 microversion: 2.1 time: 0.151412 Jun 08 02:14:14.818191 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 419/851] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:14:14 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:14:15.281883 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b915e87f-5a44-4bb2-88e0-8aa334d05caa tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:14:15.282835 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-b915e87f-5a44-4bb2-88e0-8aa334d05caa tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 8870cf32-82de-4bee-98fd-08b49f529cf3] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:14:15.289618 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b915e87f-5a44-4bb2-88e0-8aa334d05caa tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:15.290069 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b915e87f-5a44-4bb2-88e0-8aa334d05caa tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:15.290822 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b915e87f-5a44-4bb2-88e0-8aa334d05caa tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:15.291254 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b915e87f-5a44-4bb2-88e0-8aa334d05caa tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:15.356295 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b915e87f-5a44-4bb2-88e0-8aa334d05caa tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:14:15.364953 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-b915e87f-5a44-4bb2-88e0-8aa334d05caa tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3" status: 200 len: 1237 microversion: 2.1 time: 0.086934 Jun 08 02:14:15.365503 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 433/852] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:14:15 2022] GET /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3 => generated 1237 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:14:15.834366 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-74a65758-4a4a-472f-8ab5-38d3d77ec2b7 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:14:15.835051 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-74a65758-4a4a-472f-8ab5-38d3d77ec2b7 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:14:15.841640 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-74a65758-4a4a-472f-8ab5-38d3d77ec2b7 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:15.842091 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-74a65758-4a4a-472f-8ab5-38d3d77ec2b7 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:15.842860 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-74a65758-4a4a-472f-8ab5-38d3d77ec2b7 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:15.843298 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-74a65758-4a4a-472f-8ab5-38d3d77ec2b7 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:16.135989 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-74a65758-4a4a-472f-8ab5-38d3d77ec2b7 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0ae440fa644f1296d2b474c5335ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0724451ec94fdbb4f2422c44245b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:14:16.144081 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-74a65758-4a4a-472f-8ab5-38d3d77ec2b7 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 200 len: 1555 microversion: 2.1 time: 0.313776 Jun 08 02:14:16.144688 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 420/853] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:14:15 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 1555 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:14:16.382749 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-6bec38a2-1139-4c86-8c93-4a630808d456 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:14:16.383374 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-6bec38a2-1139-4c86-8c93-4a630808d456 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 8870cf32-82de-4bee-98fd-08b49f529cf3] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:14:16.390198 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6bec38a2-1139-4c86-8c93-4a630808d456 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:16.390659 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6bec38a2-1139-4c86-8c93-4a630808d456 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:16.391499 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6bec38a2-1139-4c86-8c93-4a630808d456 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:16.392567 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6bec38a2-1139-4c86-8c93-4a630808d456 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:16.481494 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-6bec38a2-1139-4c86-8c93-4a630808d456 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:14:16.490212 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-6bec38a2-1139-4c86-8c93-4a630808d456 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3" status: 200 len: 1299 microversion: 2.1 time: 0.111433 Jun 08 02:14:16.490803 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 434/854] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:14:16 2022] GET /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3 => generated 1299 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:14:16.502653 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-996eb09b-96c9-48da-909c-b9a91f14a298 req-ab2da4cd-5fc9-4306-8f74-2e2ec5f3f110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b532af5d-7b14-4644-add7-8b716f81871f", "name": "network-vif-deleted", "tag": "906aaccc-01a6-40cf-a960-5f798d175167"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:14:16.512554 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-996eb09b-96c9-48da-909c-b9a91f14a298 req-ab2da4cd-5fc9-4306-8f74-2e2ec5f3f110 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:16.513182 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-996eb09b-96c9-48da-909c-b9a91f14a298 req-ab2da4cd-5fc9-4306-8f74-2e2ec5f3f110 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:16.526532 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-996eb09b-96c9-48da-909c-b9a91f14a298 req-ab2da4cd-5fc9-4306-8f74-2e2ec5f3f110 service nova] Creating event network-vif-deleted:906aaccc-01a6-40cf-a960-5f798d175167 for instance b532af5d-7b14-4644-add7-8b716f81871f on hv-cinder-84506 Jun 08 02:14:16.532109 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-996eb09b-96c9-48da-909c-b9a91f14a298 req-ab2da4cd-5fc9-4306-8f74-2e2ec5f3f110 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035096 Jun 08 02:14:16.533325 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 421/855] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:14:17.162138 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-18118799-58cf-43ae-89bb-60937b046b3b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:14:17.162751 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-18118799-58cf-43ae-89bb-60937b046b3b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] [instance: b532af5d-7b14-4644-add7-8b716f81871f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:14:17.168706 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-18118799-58cf-43ae-89bb-60937b046b3b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:17.169361 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-18118799-58cf-43ae-89bb-60937b046b3b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:17.170116 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-18118799-58cf-43ae-89bb-60937b046b3b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:17.170546 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-18118799-58cf-43ae-89bb-60937b046b3b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:17.185303 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-18118799-58cf-43ae-89bb-60937b046b3b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] HTTP exception thrown: Instance b532af5d-7b14-4644-add7-8b716f81871f could not be found. Jun 08 02:14:17.186986 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-18118799-58cf-43ae-89bb-60937b046b3b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Request method failure captured: Jun 08 02:14:17.186986 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f HTTP/1.1 Jun 08 02:14:17.186986 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept: application/json Jun 08 02:14:17.186986 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jun 08 02:14:17.186986 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Connection: close Jun 08 02:14:17.186986 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jun 08 02:14:17.186986 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jun 08 02:14:17.186986 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Host: 10.222.0.20 Jun 08 02:14:17.186986 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jun 08 02:14:17.186986 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jun 08 02:14:17.186986 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABioAVhhHQHs18KmPAUcBzzRv5rLicGngJGENFBO_x_gxHkgmhlR7AbcRLGP_SCiKtTFpm0knAybwcZJygcLlmOmk7my6NtLcKTlSpqfqG3vw0mASmg_cYiMOwIZwvI1S3jKPvYNDULbMjg7V3Cp7qUFaA5ayXs-O5EiwsTfnv17LOHlAI Jun 08 02:14:17.186986 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jun 08 02:14:17.186986 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jun 08 02:14:17.186986 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jun 08 02:14:17.186986 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jun 08 02:14:17.186986 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jun 08 02:14:17.186986 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jun 08 02:14:17.186986 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Id: 3b0724451ec94fdbb4f2422c44245b53 Jun 08 02:14:17.186986 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-TestMinimumBasicScenario-870826201 Jun 08 02:14:17.186986 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jun 08 02:14:17.186986 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jun 08 02:14:17.189294 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b0724451ec94fdbb4f2422c44245b53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3b0724451ec94fdbb4f2422c44245b53", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3b0724451ec94fdbb4f2422c44245b53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b0724451ec94fdbb4f2422c44245b53"}]}] Jun 08 02:14:17.189294 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-TestMinimumBasicScenario-870826201 Jun 08 02:14:17.189294 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 3b0724451ec94fdbb4f2422c44245b53 Jun 08 02:14:17.189294 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-TestMinimumBasicScenario-870826201 Jun 08 02:14:17.189294 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User: tempest-TestMinimumBasicScenario-870826201-project Jun 08 02:14:17.189294 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jun 08 02:14:17.189294 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jun 08 02:14:17.189294 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Id: 2f0ae440fa644f1296d2b474c5335ffc Jun 08 02:14:17.189294 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-TestMinimumBasicScenario-870826201-project Jun 08 02:14:17.189294 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: method: > Jun 08 02:14:17.189294 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: exception: Instance b532af5d-7b14-4644-add7-8b716f81871f could not be found. Jun 08 02:14:17.189294 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: action_args: {'id': 'b532af5d-7b14-4644-add7-8b716f81871f'} Jun 08 02:14:17.190135 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:14:17.190135 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:14:17.190135 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:14:17.190135 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:14:17.190135 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:14:17.190135 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:14:17.190135 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:14:17.190135 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:14:17.190135 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:14:17.190135 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:14:17.190135 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b532af5d-7b14-4644-add7-8b716f81871f could not be found. Jun 08 02:14:17.190135 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:14:17.190135 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:14:17.190135 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:14:17.190135 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:14:17.190135 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:14:17.190135 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:14:17.190135 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:14:17.190135 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:14:17.190135 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:14:17.191646 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:14:17.191646 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 02:14:17.191646 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 02:14:17.191646 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:14:17.191646 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:14:17.191646 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:14:17.191646 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:14:17.191646 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b532af5d-7b14-4644-add7-8b716f81871f could not be found. Jun 08 02:14:17.191646 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:14:17.191646 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:14:17.191646 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:14:17.191646 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:14:17.191646 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:14:17.191646 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:14:17.191646 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:14:17.191646 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:14:17.191646 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b532af5d-7b14-4644-add7-8b716f81871f could not be found. Jun 08 02:14:17.191646 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:14:17.194259 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-18118799-58cf-43ae-89bb-60937b046b3b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Returning 404 to user: Instance b532af5d-7b14-4644-add7-8b716f81871f could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:14:17.195126 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-18118799-58cf-43ae-89bb-60937b046b3b tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f" status: 404 len: 111 microversion: 2.1 time: 0.038668 Jun 08 02:14:17.196281 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 435/856] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:14:17 2022] GET /compute/v2.1/servers/b532af5d-7b14-4644-add7-8b716f81871f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 02:14:17.205259 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4fe07fe9-b2f6-4c2c-88c9-049188a0fca0 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] Calling method '.version_select at 0x7f836af561f0>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:14:17.223305 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4fe07fe9-b2f6-4c2c-88c9-049188a0fca0 tempest-TestMinimumBasicScenario-870826201 tempest-TestMinimumBasicScenario-870826201-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1419205293" status: 202 len: 0 microversion: 2.1 time: 0.022491 Jun 08 02:14:17.223994 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 422/857] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jun 8 02:14:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1419205293 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 02:14:17.507921 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-aa23fd90-b30e-419b-91c9-44eabfcfd8a6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:14:17.508661 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-aa23fd90-b30e-419b-91c9-44eabfcfd8a6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 8870cf32-82de-4bee-98fd-08b49f529cf3] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:14:17.522069 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-aa23fd90-b30e-419b-91c9-44eabfcfd8a6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:17.522535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-aa23fd90-b30e-419b-91c9-44eabfcfd8a6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:17.537528 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-aa23fd90-b30e-419b-91c9-44eabfcfd8a6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:17.538014 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-aa23fd90-b30e-419b-91c9-44eabfcfd8a6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:18.005681 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-aa23fd90-b30e-419b-91c9-44eabfcfd8a6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:14:18.014143 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-aa23fd90-b30e-419b-91c9-44eabfcfd8a6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3" status: 200 len: 1366 microversion: 2.1 time: 0.510459 Jun 08 02:14:18.024119 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 436/858] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:14:17 2022] GET /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3 => generated 1366 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:14:18.549549 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-5c84d266-03a1-4bd1-86f9-92faf693448b req-d28a0ff4-52e2-4dc3-a093-7802363b45db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8870cf32-82de-4bee-98fd-08b49f529cf3", "tag": "08d25dda-6fc8-4471-9351-39547da360c2"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:14:18.558332 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-5c84d266-03a1-4bd1-86f9-92faf693448b req-d28a0ff4-52e2-4dc3-a093-7802363b45db service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:18.558777 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-5c84d266-03a1-4bd1-86f9-92faf693448b req-d28a0ff4-52e2-4dc3-a093-7802363b45db service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:18.569847 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-5c84d266-03a1-4bd1-86f9-92faf693448b req-d28a0ff4-52e2-4dc3-a093-7802363b45db service nova] Creating event network-changed:08d25dda-6fc8-4471-9351-39547da360c2 for instance 8870cf32-82de-4bee-98fd-08b49f529cf3 on hv-cinder-84506 Jun 08 02:14:18.575268 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-5c84d266-03a1-4bd1-86f9-92faf693448b req-d28a0ff4-52e2-4dc3-a093-7802363b45db service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029267 Jun 08 02:14:18.576069 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 423/859] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:14:19.031530 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-633e8e66-6dcb-449e-a8ce-2d17c22e6a00 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:14:19.032299 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-633e8e66-6dcb-449e-a8ce-2d17c22e6a00 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 8870cf32-82de-4bee-98fd-08b49f529cf3] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:14:19.039330 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-633e8e66-6dcb-449e-a8ce-2d17c22e6a00 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:19.039808 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-633e8e66-6dcb-449e-a8ce-2d17c22e6a00 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:19.040669 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-633e8e66-6dcb-449e-a8ce-2d17c22e6a00 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:19.041099 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-633e8e66-6dcb-449e-a8ce-2d17c22e6a00 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:19.171410 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-633e8e66-6dcb-449e-a8ce-2d17c22e6a00 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:14:19.179697 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-633e8e66-6dcb-449e-a8ce-2d17c22e6a00 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3" status: 200 len: 1366 microversion: 2.1 time: 0.151922 Jun 08 02:14:19.180441 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 437/860] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:14:19 2022] GET /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:14:20.197602 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9493e8f7-ace0-44dc-acca-fb9ed1d31f15 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:14:20.198219 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9493e8f7-ace0-44dc-acca-fb9ed1d31f15 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 8870cf32-82de-4bee-98fd-08b49f529cf3] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:14:20.204779 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9493e8f7-ace0-44dc-acca-fb9ed1d31f15 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:20.205234 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9493e8f7-ace0-44dc-acca-fb9ed1d31f15 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:20.206027 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9493e8f7-ace0-44dc-acca-fb9ed1d31f15 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:20.206471 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9493e8f7-ace0-44dc-acca-fb9ed1d31f15 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:20.418586 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9493e8f7-ace0-44dc-acca-fb9ed1d31f15 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:14:20.426177 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9493e8f7-ace0-44dc-acca-fb9ed1d31f15 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3" status: 200 len: 1366 microversion: 2.1 time: 0.233359 Jun 08 02:14:20.435720 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 424/861] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:14:20 2022] GET /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:14:21.443652 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-9de89b69-d154-4a4b-be11-e38e5c8733ca tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:14:21.444467 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-9de89b69-d154-4a4b-be11-e38e5c8733ca tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 8870cf32-82de-4bee-98fd-08b49f529cf3] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:14:21.451641 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9de89b69-d154-4a4b-be11-e38e5c8733ca tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:21.452334 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9de89b69-d154-4a4b-be11-e38e5c8733ca tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:21.453150 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9de89b69-d154-4a4b-be11-e38e5c8733ca tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:21.453591 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9de89b69-d154-4a4b-be11-e38e5c8733ca tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:21.582697 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-9de89b69-d154-4a4b-be11-e38e5c8733ca tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:14:21.590032 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-9de89b69-d154-4a4b-be11-e38e5c8733ca tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3" status: 200 len: 1366 microversion: 2.1 time: 0.150259 Jun 08 02:14:21.590600 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 438/862] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:14:21 2022] GET /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:14:22.611877 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b9e2b754-d8d8-4b9d-85ee-fd15390ea1ee tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:14:22.612534 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b9e2b754-d8d8-4b9d-85ee-fd15390ea1ee tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 8870cf32-82de-4bee-98fd-08b49f529cf3] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:14:22.619399 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b9e2b754-d8d8-4b9d-85ee-fd15390ea1ee tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:22.619872 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b9e2b754-d8d8-4b9d-85ee-fd15390ea1ee tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:22.620672 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b9e2b754-d8d8-4b9d-85ee-fd15390ea1ee tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:22.621128 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b9e2b754-d8d8-4b9d-85ee-fd15390ea1ee tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:22.764089 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b9e2b754-d8d8-4b9d-85ee-fd15390ea1ee tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:14:22.772264 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b9e2b754-d8d8-4b9d-85ee-fd15390ea1ee tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3" status: 200 len: 1366 microversion: 2.1 time: 0.165031 Jun 08 02:14:22.780851 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 425/863] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:14:22 2022] GET /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:14:23.795358 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-8cf19c80-fde8-4909-88aa-cf93044c5f6d tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:14:23.795978 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-8cf19c80-fde8-4909-88aa-cf93044c5f6d tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 8870cf32-82de-4bee-98fd-08b49f529cf3] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:14:23.804529 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8cf19c80-fde8-4909-88aa-cf93044c5f6d tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:23.805197 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8cf19c80-fde8-4909-88aa-cf93044c5f6d tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:23.806168 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8cf19c80-fde8-4909-88aa-cf93044c5f6d tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:23.806658 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8cf19c80-fde8-4909-88aa-cf93044c5f6d tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:23.952186 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-8cf19c80-fde8-4909-88aa-cf93044c5f6d tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:14:23.961305 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-8cf19c80-fde8-4909-88aa-cf93044c5f6d tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3" status: 200 len: 1366 microversion: 2.1 time: 0.174159 Jun 08 02:14:23.962043 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 439/864] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:14:23 2022] GET /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:14:24.286073 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-98a4167a-bbc5-46a4-a5a8-f9b48c47873a req-511d339f-a513-45c4-be51-bac808be6e97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8870cf32-82de-4bee-98fd-08b49f529cf3", "name": "network-vif-plugged", "status": "completed", "tag": "08d25dda-6fc8-4471-9351-39547da360c2"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:14:24.294590 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:14:24.295464 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=6 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:14:24.303518 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-98a4167a-bbc5-46a4-a5a8-f9b48c47873a req-511d339f-a513-45c4-be51-bac808be6e97 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:24.303999 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-98a4167a-bbc5-46a4-a5a8-f9b48c47873a req-511d339f-a513-45c4-be51-bac808be6e97 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:24.317817 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-98a4167a-bbc5-46a4-a5a8-f9b48c47873a req-511d339f-a513-45c4-be51-bac808be6e97 service nova] Creating event network-vif-plugged:08d25dda-6fc8-4471-9351-39547da360c2 for instance 8870cf32-82de-4bee-98fd-08b49f529cf3 on hv-cinder-84506 Jun 08 02:14:24.323243 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-98a4167a-bbc5-46a4-a5a8-f9b48c47873a req-511d339f-a513-45c4-be51-bac808be6e97 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041945 Jun 08 02:14:24.323995 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 426/865] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 02:14:24.978472 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-cb97ac92-98c7-48db-8c77-323bfc2f714f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:14:24.979089 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-cb97ac92-98c7-48db-8c77-323bfc2f714f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 8870cf32-82de-4bee-98fd-08b49f529cf3] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:14:24.981076 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=6 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:14:24.987663 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cb97ac92-98c7-48db-8c77-323bfc2f714f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:24.988111 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cb97ac92-98c7-48db-8c77-323bfc2f714f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:24.988903 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cb97ac92-98c7-48db-8c77-323bfc2f714f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:24.989332 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cb97ac92-98c7-48db-8c77-323bfc2f714f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:25.129103 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-cb97ac92-98c7-48db-8c77-323bfc2f714f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:14:25.137091 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-cb97ac92-98c7-48db-8c77-323bfc2f714f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3" status: 200 len: 1366 microversion: 2.1 time: 0.162596 Jun 08 02:14:25.137757 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 440/866] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:14:24 2022] GET /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:14:26.156820 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6c2e3ded-6720-4914-84d1-0ccdff580e6e tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:14:26.158634 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6c2e3ded-6720-4914-84d1-0ccdff580e6e tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 8870cf32-82de-4bee-98fd-08b49f529cf3] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:14:26.166049 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6c2e3ded-6720-4914-84d1-0ccdff580e6e tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:26.166491 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6c2e3ded-6720-4914-84d1-0ccdff580e6e tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:26.167260 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6c2e3ded-6720-4914-84d1-0ccdff580e6e tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:26.167688 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6c2e3ded-6720-4914-84d1-0ccdff580e6e tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:26.303820 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6c2e3ded-6720-4914-84d1-0ccdff580e6e tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:14:26.312239 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6c2e3ded-6720-4914-84d1-0ccdff580e6e tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3" status: 200 len: 1555 microversion: 2.1 time: 0.160486 Jun 08 02:14:26.312872 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 427/867] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:14:26 2022] GET /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:14:26.329867 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-eab33876-ec8e-4908-91fd-b552d4fe332f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:14:26.330770 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-eab33876-ec8e-4908-91fd-b552d4fe332f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 8870cf32-82de-4bee-98fd-08b49f529cf3] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:14:26.337698 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eab33876-ec8e-4908-91fd-b552d4fe332f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:26.338147 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eab33876-ec8e-4908-91fd-b552d4fe332f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:26.339030 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eab33876-ec8e-4908-91fd-b552d4fe332f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:26.339501 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eab33876-ec8e-4908-91fd-b552d4fe332f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:26.421695 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-eab33876-ec8e-4908-91fd-b552d4fe332f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096254 Jun 08 02:14:26.422948 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 441/868] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jun 8 02:14:26 2022] GET /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 02:14:27.527284 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-e89ff86c-a9c5-4987-b162-30db497ead90 req-09afa0ea-a51d-43d0-a0a2-5bb3ac8ee888 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8870cf32-82de-4bee-98fd-08b49f529cf3", "tag": "08d25dda-6fc8-4471-9351-39547da360c2"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:14:27.545155 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-e89ff86c-a9c5-4987-b162-30db497ead90 req-09afa0ea-a51d-43d0-a0a2-5bb3ac8ee888 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:27.545883 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-e89ff86c-a9c5-4987-b162-30db497ead90 req-09afa0ea-a51d-43d0-a0a2-5bb3ac8ee888 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:27.558930 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-e89ff86c-a9c5-4987-b162-30db497ead90 req-09afa0ea-a51d-43d0-a0a2-5bb3ac8ee888 service nova] Creating event network-changed:08d25dda-6fc8-4471-9351-39547da360c2 for instance 8870cf32-82de-4bee-98fd-08b49f529cf3 on hv-cinder-84506 Jun 08 02:14:27.565641 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-e89ff86c-a9c5-4987-b162-30db497ead90 req-09afa0ea-a51d-43d0-a0a2-5bb3ac8ee888 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054580 Jun 08 02:14:27.566294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 428/869] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:14:36.792128 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:14:36.793331 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:14:36.985611 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-37962cee-0fad-41d0-8276-e48d95f5d487 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Action: 'create', calling method: .version_select at 0x7f836ae9b3a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-153398192", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsGzBa1TANe3cdLzN4dy35imIZXgcAR2+v0gyDOmaHOKAOeZtPbAlwai6N3lbaau7NdV/cepFWqo6IYLfIKtddg9Uuxx35t0niujQa+k5+/Ojt1fk6noB11uWem6fXBOg=="}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:14:36.999459 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-37962cee-0fad-41d0-8276-e48d95f5d487 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Getting quotas for project 079027b24aba4a179f99de9f6fe944b8. Resources: {'key_pairs'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 02:14:37.004111 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-37962cee-0fad-41d0-8276-e48d95f5d487 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Getting quotas for user 89e6c19fcc9f490c890fc4d6350273a0 and project 079027b24aba4a179f99de9f6fe944b8. Resources: {'key_pairs'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 02:14:37.027084 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-37962cee-0fad-41d0-8276-e48d95f5d487 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.236254 Jun 08 02:14:37.028016 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 442/870] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jun 8 02:14:36 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:14:54.258607 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:14:54.259744 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:14:54.264253 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d46b125c-beea-45f6-a1dd-534d3674f1a0 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-511112263", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-153398192", "security_groups": [{"name": "tempest-secgroup-smoke-1399273772"}], "block_device_mapping_v2": [{"uuid": "e62d09e1-f36c-4c88-ab91-a0f29e785fcc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "05318a5a-b32e-458e-9f7c-d5bc705960a2"}]}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:14:54.376281 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.network.neutron [None req-d46b125c-beea-45f6-a1dd-534d3674f1a0 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] validate_networks() for [('05318a5a-b32e-458e-9f7c-d5bc705960a2', None, None, None, None, None)] {{(pid=117938) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 02:14:54.734003 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-d46b125c-beea-45f6-a1dd-534d3674f1a0 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Flavor limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 02:14:54.734449 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-d46b125c-beea-45f6-a1dd-534d3674f1a0 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Image limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 02:14:54.734915 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-d46b125c-beea-45f6-a1dd-534d3674f1a0 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Flavor pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 02:14:54.735315 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-d46b125c-beea-45f6-a1dd-534d3674f1a0 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Image pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 02:14:54.735715 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-d46b125c-beea-45f6-a1dd-534d3674f1a0 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 02:14:54.744587 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d46b125c-beea-45f6-a1dd-534d3674f1a0 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:54.745028 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d46b125c-beea-45f6-a1dd-534d3674f1a0 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:54.745812 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d46b125c-beea-45f6-a1dd-534d3674f1a0 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:54.746242 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d46b125c-beea-45f6-a1dd-534d3674f1a0 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:54.762789 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-d46b125c-beea-45f6-a1dd-534d3674f1a0 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Getting quotas for project 079027b24aba4a179f99de9f6fe944b8. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 02:14:54.766765 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-d46b125c-beea-45f6-a1dd-534d3674f1a0 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Getting quotas for user 89e6c19fcc9f490c890fc4d6350273a0 and project 079027b24aba4a179f99de9f6fe944b8. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 02:14:54.824969 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d46b125c-beea-45f6-a1dd-534d3674f1a0 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Going to run 1 instances... {{(pid=117938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 02:14:54.827161 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d46b125c-beea-45f6-a1dd-534d3674f1a0 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: d215906f-096e-4a61-8b14-8a48d6262be8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e62d09e1-f36c-4c88-ab91-a0f29e785fcc',volume_size=None,volume_type=None)] {{(pid=117938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 02:14:54.951624 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d46b125c-beea-45f6-a1dd-534d3674f1a0 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.694488 Jun 08 02:14:54.952264 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 429/871] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jun 8 02:14:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 08 02:14:54.962292 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-42646ce8-dd1e-42fb-b2dd-312ee97fdba0 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:14:54.962893 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-42646ce8-dd1e-42fb-b2dd-312ee97fdba0 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: d215906f-096e-4a61-8b14-8a48d6262be8] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:14:54.965298 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=4 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:14:54.965937 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:14:55.022692 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-42646ce8-dd1e-42fb-b2dd-312ee97fdba0 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:14:55.029466 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-42646ce8-dd1e-42fb-b2dd-312ee97fdba0 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8" status: 200 len: 1093 microversion: 2.1 time: 0.070970 Jun 08 02:14:55.030029 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 443/872] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:14:54 2022] GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8 => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:14:56.047150 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-13bd2341-6605-478e-bad4-dcd2b5ab79bd tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:14:56.047855 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-13bd2341-6605-478e-bad4-dcd2b5ab79bd tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: d215906f-096e-4a61-8b14-8a48d6262be8] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:14:56.057183 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-13bd2341-6605-478e-bad4-dcd2b5ab79bd tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:56.057478 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-13bd2341-6605-478e-bad4-dcd2b5ab79bd tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:56.058261 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-13bd2341-6605-478e-bad4-dcd2b5ab79bd tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:56.058693 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-13bd2341-6605-478e-bad4-dcd2b5ab79bd tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:56.154262 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-13bd2341-6605-478e-bad4-dcd2b5ab79bd tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:14:56.162085 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-13bd2341-6605-478e-bad4-dcd2b5ab79bd tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8" status: 200 len: 1209 microversion: 2.1 time: 0.118819 Jun 08 02:14:56.162649 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 430/873] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:14:56 2022] GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8 => generated 1209 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:14:57.179417 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-79dfabef-2131-4947-9e0f-3166a7178951 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:14:57.180151 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-79dfabef-2131-4947-9e0f-3166a7178951 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: d215906f-096e-4a61-8b14-8a48d6262be8] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:14:57.187050 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-79dfabef-2131-4947-9e0f-3166a7178951 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:57.187579 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-79dfabef-2131-4947-9e0f-3166a7178951 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:57.188971 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-79dfabef-2131-4947-9e0f-3166a7178951 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:57.189478 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-79dfabef-2131-4947-9e0f-3166a7178951 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:57.399694 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-38173a5e-52b3-4cf1-b088-714cd7787300 req-eac5e67d-efb4-4119-86bb-d696360bca45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d215906f-096e-4a61-8b14-8a48d6262be8", "tag": "06b10b26-b9d9-4902-8c66-22b270f6722e"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:14:57.411356 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-38173a5e-52b3-4cf1-b088-714cd7787300 req-eac5e67d-efb4-4119-86bb-d696360bca45 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:57.412152 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-38173a5e-52b3-4cf1-b088-714cd7787300 req-eac5e67d-efb4-4119-86bb-d696360bca45 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:57.435708 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-79dfabef-2131-4947-9e0f-3166a7178951 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:14:57.443051 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-38173a5e-52b3-4cf1-b088-714cd7787300 req-eac5e67d-efb4-4119-86bb-d696360bca45 service nova] Creating event network-changed:06b10b26-b9d9-4902-8c66-22b270f6722e for instance d215906f-096e-4a61-8b14-8a48d6262be8 on hv-cinder-84506 Jun 08 02:14:57.448201 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-79dfabef-2131-4947-9e0f-3166a7178951 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8" status: 200 len: 1265 microversion: 2.1 time: 0.272933 Jun 08 02:14:57.448819 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 444/874] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:14:57 2022] GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8 => generated 1265 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:14:57.454250 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-38173a5e-52b3-4cf1-b088-714cd7787300 req-eac5e67d-efb4-4119-86bb-d696360bca45 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058216 Jun 08 02:14:57.455289 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 431/875] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:14:58.465862 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a66a6522-da8d-4105-8b24-e8251d597b2b tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:14:58.466612 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a66a6522-da8d-4105-8b24-e8251d597b2b tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: d215906f-096e-4a61-8b14-8a48d6262be8] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:14:58.474335 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a66a6522-da8d-4105-8b24-e8251d597b2b tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:58.474879 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a66a6522-da8d-4105-8b24-e8251d597b2b tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:58.475659 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a66a6522-da8d-4105-8b24-e8251d597b2b tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:58.476085 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a66a6522-da8d-4105-8b24-e8251d597b2b tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:58.651117 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a66a6522-da8d-4105-8b24-e8251d597b2b tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:14:58.660420 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a66a6522-da8d-4105-8b24-e8251d597b2b tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8" status: 200 len: 1265 microversion: 2.1 time: 0.197941 Jun 08 02:14:58.661737 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 445/876] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:14:58 2022] GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8 => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:14:59.680921 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-475ed59a-ec06-4efc-8090-ce625a50b470 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:14:59.681631 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-475ed59a-ec06-4efc-8090-ce625a50b470 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: d215906f-096e-4a61-8b14-8a48d6262be8] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:14:59.688225 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-475ed59a-ec06-4efc-8090-ce625a50b470 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:59.688695 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-475ed59a-ec06-4efc-8090-ce625a50b470 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:59.689450 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-475ed59a-ec06-4efc-8090-ce625a50b470 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:14:59.689895 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-475ed59a-ec06-4efc-8090-ce625a50b470 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:14:59.821132 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-475ed59a-ec06-4efc-8090-ce625a50b470 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:14:59.828476 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-475ed59a-ec06-4efc-8090-ce625a50b470 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8" status: 200 len: 1265 microversion: 2.1 time: 0.151766 Jun 08 02:14:59.829032 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 432/877] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:14:59 2022] GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:15:00.845408 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d7864f36-b3cc-4e83-a900-a18b2f6ae9f2 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:00.846041 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d7864f36-b3cc-4e83-a900-a18b2f6ae9f2 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: d215906f-096e-4a61-8b14-8a48d6262be8] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:15:00.853626 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d7864f36-b3cc-4e83-a900-a18b2f6ae9f2 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:00.854066 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d7864f36-b3cc-4e83-a900-a18b2f6ae9f2 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:00.854815 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d7864f36-b3cc-4e83-a900-a18b2f6ae9f2 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:00.855244 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d7864f36-b3cc-4e83-a900-a18b2f6ae9f2 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:00.985862 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d7864f36-b3cc-4e83-a900-a18b2f6ae9f2 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:15:00.993823 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d7864f36-b3cc-4e83-a900-a18b2f6ae9f2 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8" status: 200 len: 1265 microversion: 2.1 time: 0.151890 Jun 08 02:15:00.994847 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 446/878] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:15:00 2022] GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:15:02.013911 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-62d44973-2ded-40d7-b322-04fe1e319e77 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:02.014516 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-62d44973-2ded-40d7-b322-04fe1e319e77 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: d215906f-096e-4a61-8b14-8a48d6262be8] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:15:02.020985 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-62d44973-2ded-40d7-b322-04fe1e319e77 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:02.021422 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-62d44973-2ded-40d7-b322-04fe1e319e77 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:02.022172 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-62d44973-2ded-40d7-b322-04fe1e319e77 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:02.022603 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-62d44973-2ded-40d7-b322-04fe1e319e77 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:02.150667 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-62d44973-2ded-40d7-b322-04fe1e319e77 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:15:02.157968 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-62d44973-2ded-40d7-b322-04fe1e319e77 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8" status: 200 len: 1265 microversion: 2.1 time: 0.147942 Jun 08 02:15:02.158520 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 433/879] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:15:02 2022] GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:15:03.176086 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e2aebfba-9cdb-4cc5-a909-0ea8ae13eba1 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:03.176869 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e2aebfba-9cdb-4cc5-a909-0ea8ae13eba1 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: d215906f-096e-4a61-8b14-8a48d6262be8] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:15:03.183151 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e2aebfba-9cdb-4cc5-a909-0ea8ae13eba1 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:03.183595 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e2aebfba-9cdb-4cc5-a909-0ea8ae13eba1 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:03.184374 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e2aebfba-9cdb-4cc5-a909-0ea8ae13eba1 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:03.184841 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e2aebfba-9cdb-4cc5-a909-0ea8ae13eba1 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:03.231650 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a5e1224a-b9e1-49be-8205-daadf853cea0 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:03.232222 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a5e1224a-b9e1-49be-8205-daadf853cea0 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 8870cf32-82de-4bee-98fd-08b49f529cf3] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:15:03.239731 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a5e1224a-b9e1-49be-8205-daadf853cea0 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:03.240246 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a5e1224a-b9e1-49be-8205-daadf853cea0 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:03.241098 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a5e1224a-b9e1-49be-8205-daadf853cea0 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:03.241593 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a5e1224a-b9e1-49be-8205-daadf853cea0 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:03.265147 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a5e1224a-b9e1-49be-8205-daadf853cea0 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3/ips" status: 200 len: 149 microversion: 2.1 time: 0.037233 Jun 08 02:15:03.266096 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 434/880] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Jun 8 02:15:03 2022] GET /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 02:15:03.275939 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-82377ecd-cb50-4d2a-848e-1fb2a639d728 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5bb933a-8fcd-4ba0-82c9-75d68bc13d64"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:15:03.277018 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-82377ecd-cb50-4d2a-848e-1fb2a639d728 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 8870cf32-82de-4bee-98fd-08b49f529cf3] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:15:03.283087 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-82377ecd-cb50-4d2a-848e-1fb2a639d728 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:03.283539 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-82377ecd-cb50-4d2a-848e-1fb2a639d728 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:03.285010 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-82377ecd-cb50-4d2a-848e-1fb2a639d728 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:03.285477 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-82377ecd-cb50-4d2a-848e-1fb2a639d728 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:03.321381 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e2aebfba-9cdb-4cc5-a909-0ea8ae13eba1 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:15:03.329287 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e2aebfba-9cdb-4cc5-a909-0ea8ae13eba1 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8" status: 200 len: 1265 microversion: 2.1 time: 0.157631 Jun 08 02:15:03.329845 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 447/881] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:15:03 2022] GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:15:03.366481 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-82377ecd-cb50-4d2a-848e-1fb2a639d728 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] HTTP exception thrown: Invalid volume: volume a5bb933a-8fcd-4ba0-82c9-75d68bc13d64 is already attached to instances: 78009a5e-d759-4faf-8ef4-fe4d5612a690 Jun 08 02:15:03.368189 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-82377ecd-cb50-4d2a-848e-1fb2a639d728 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Request method failure captured: Jun 08 02:15:03.368189 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: request: POST /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3/os-volume_attachments HTTP/1.1 Jun 08 02:15:03.368189 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept: application/json Jun 08 02:15:03.368189 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jun 08 02:15:03.368189 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Connection: close Jun 08 02:15:03.368189 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Length: 74 Jun 08 02:15:03.368189 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jun 08 02:15:03.368189 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Host: 10.222.0.20 Jun 08 02:15:03.368189 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jun 08 02:15:03.368189 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jun 08 02:15:03.368189 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABioAW4IUxpz8uFDDL-2EiTBkCBex8I37pHedcb3KtOxR_5Qkw-FZcb_F__ZONQItVnmknDOkkzAj6A6u4qKVTec739oTRvutk80ABlxe7TWtEaCPh_VPhrokhrvddPC6ZdyKbKBz4FSnU6iiSRK8RTfn44nLulYip7apELdvL-QYgXa4o Jun 08 02:15:03.368189 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jun 08 02:15:03.368189 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jun 08 02:15:03.368189 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jun 08 02:15:03.368189 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jun 08 02:15:03.368189 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jun 08 02:15:03.368189 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jun 08 02:15:03.368189 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Id: 879e3eacb3bc4b69891677c86bbd5de3 Jun 08 02:15:03.368189 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:15:03.368189 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jun 08 02:15:03.368189 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jun 08 02:15:03.369884 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/879e3eacb3bc4b69891677c86bbd5de3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_879e3eacb3bc4b69891677c86bbd5de3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/879e3eacb3bc4b69891677c86bbd5de3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/879e3eacb3bc4b69891677c86bbd5de3"}]}] Jun 08 02:15:03.369884 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:15:03.369884 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 879e3eacb3bc4b69891677c86bbd5de3 Jun 08 02:15:03.369884 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:15:03.369884 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeNegativeTest-695083649-project Jun 08 02:15:03.369884 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jun 08 02:15:03.369884 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jun 08 02:15:03.369884 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Id: 92de4ab63f6447eabefe34f65c71d918 Jun 08 02:15:03.369884 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeNegativeTest-695083649-project Jun 08 02:15:03.369884 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Jun 08 02:15:03.369884 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: {"volumeAttachment": {"volumeId": "a5bb933a-8fcd-4ba0-82c9-75d68bc13d64"}} Jun 08 02:15:03.369884 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: method: > Jun 08 02:15:03.370985 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: exception: Invalid volume: volume a5bb933a-8fcd-4ba0-82c9-75d68bc13d64 is already attached to instances: 78009a5e-d759-4faf-8ef4-fe4d5612a690 Jun 08 02:15:03.370985 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: action_args: {'server_id': '8870cf32-82de-4bee-98fd-08b49f529cf3', 'body': {'volumeAttachment': {'volumeId': 'a5bb933a-8fcd-4ba0-82c9-75d68bc13d64'}}} Jun 08 02:15:03.370985 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:15:03.370985 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:15:03.370985 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 08 02:15:03.370985 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 08 02:15:03.370985 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 08 02:15:03.370985 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 08 02:15:03.370985 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 08 02:15:03.370985 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 08 02:15:03.370985 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 08 02:15:03.370985 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 08 02:15:03.370985 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 08 02:15:03.370985 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 08 02:15:03.370985 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a5bb933a-8fcd-4ba0-82c9-75d68bc13d64 is already attached to instances: 78009a5e-d759-4faf-8ef4-fe4d5612a690 Jun 08 02:15:03.370985 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:15:03.370985 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:15:03.370985 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:15:03.370985 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:15:03.372539 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:15:03.372539 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:15:03.372539 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:15:03.372539 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:15:03.372539 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:15:03.372539 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:15:03.372539 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 08 02:15:03.372539 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 08 02:15:03.372539 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 08 02:15:03.372539 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 08 02:15:03.372539 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 08 02:15:03.372539 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 08 02:15:03.372539 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 08 02:15:03.372539 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 08 02:15:03.372539 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a5bb933a-8fcd-4ba0-82c9-75d68bc13d64 is already attached to instances: 78009a5e-d759-4faf-8ef4-fe4d5612a690 Jun 08 02:15:03.372539 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:15:03.372539 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:15:03.372539 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:15:03.372539 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:15:03.372539 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:15:03.374205 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:15:03.374205 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:15:03.374205 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:15:03.374205 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a5bb933a-8fcd-4ba0-82c9-75d68bc13d64 is already attached to instances: 78009a5e-d759-4faf-8ef4-fe4d5612a690 Jun 08 02:15:03.374205 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:15:03.374205 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-82377ecd-cb50-4d2a-848e-1fb2a639d728 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Returning 400 to user: Invalid volume: volume a5bb933a-8fcd-4ba0-82c9-75d68bc13d64 is already attached to instances: 78009a5e-d759-4faf-8ef4-fe4d5612a690 {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:15:03.374205 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-82377ecd-cb50-4d2a-848e-1fb2a639d728 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "POST /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097452 Jun 08 02:15:03.374205 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 435/882] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jun 8 02:15:03 2022] POST /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 08 02:15:03.378536 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-6d0b7543-51e2-4308-aed7-f7e153622fef tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:03.379167 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-6d0b7543-51e2-4308-aed7-f7e153622fef tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 8870cf32-82de-4bee-98fd-08b49f529cf3] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:15:03.385089 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6d0b7543-51e2-4308-aed7-f7e153622fef tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:03.385535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6d0b7543-51e2-4308-aed7-f7e153622fef tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:03.386288 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6d0b7543-51e2-4308-aed7-f7e153622fef tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:03.386715 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6d0b7543-51e2-4308-aed7-f7e153622fef tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:03.412291 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-6d0b7543-51e2-4308-aed7-f7e153622fef tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 8870cf32-82de-4bee-98fd-08b49f529cf3] Going to try to terminate instance {{(pid=117939) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 02:15:03.488132 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-6d0b7543-51e2-4308-aed7-f7e153622fef tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3" status: 204 len: 0 microversion: 2.1 time: 0.113071 Jun 08 02:15:03.488728 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 448/883] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jun 8 02:15:03 2022] DELETE /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 08 02:15:03.496965 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-04252e07-2f32-433f-b1de-c98752ba0618 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:03.497703 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-04252e07-2f32-433f-b1de-c98752ba0618 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 8870cf32-82de-4bee-98fd-08b49f529cf3] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:15:03.505134 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-04252e07-2f32-433f-b1de-c98752ba0618 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:03.505582 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-04252e07-2f32-433f-b1de-c98752ba0618 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:03.506339 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-04252e07-2f32-433f-b1de-c98752ba0618 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:03.506777 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-04252e07-2f32-433f-b1de-c98752ba0618 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:03.633263 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-04252e07-2f32-433f-b1de-c98752ba0618 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:15:03.640673 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-04252e07-2f32-433f-b1de-c98752ba0618 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3" status: 200 len: 1680 microversion: 2.1 time: 0.147563 Jun 08 02:15:03.641233 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 436/884] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:15:03 2022] GET /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:15:04.347229 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-13df2f54-054c-45ae-bea8-ce56299a1b83 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:04.347958 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-13df2f54-054c-45ae-bea8-ce56299a1b83 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: d215906f-096e-4a61-8b14-8a48d6262be8] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:15:04.354367 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-13df2f54-054c-45ae-bea8-ce56299a1b83 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:04.354813 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-13df2f54-054c-45ae-bea8-ce56299a1b83 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:04.355570 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-13df2f54-054c-45ae-bea8-ce56299a1b83 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:04.356000 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-13df2f54-054c-45ae-bea8-ce56299a1b83 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:04.482428 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-13df2f54-054c-45ae-bea8-ce56299a1b83 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:15:04.490515 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-13df2f54-054c-45ae-bea8-ce56299a1b83 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8" status: 200 len: 1265 microversion: 2.1 time: 0.147991 Jun 08 02:15:04.491015 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 449/885] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:15:04 2022] GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:15:04.659015 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-18ffaa11-2936-461a-970a-3075017637f9 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:04.660220 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-18ffaa11-2936-461a-970a-3075017637f9 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 8870cf32-82de-4bee-98fd-08b49f529cf3] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:15:04.667067 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-18ffaa11-2936-461a-970a-3075017637f9 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:04.667515 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-18ffaa11-2936-461a-970a-3075017637f9 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:04.668276 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-18ffaa11-2936-461a-970a-3075017637f9 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:04.668740 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-18ffaa11-2936-461a-970a-3075017637f9 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:04.754536 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:15:04.773910 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=6 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:15:04.803708 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-18ffaa11-2936-461a-970a-3075017637f9 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:15:04.811307 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-18ffaa11-2936-461a-970a-3075017637f9 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3" status: 200 len: 1680 microversion: 2.1 time: 0.156203 Jun 08 02:15:04.811858 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 437/886] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:15:04 2022] GET /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:15:05.507648 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2e1efcd6-11ed-4b64-9a3e-d26cf143022f tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:05.508266 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-2e1efcd6-11ed-4b64-9a3e-d26cf143022f tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: d215906f-096e-4a61-8b14-8a48d6262be8] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:15:05.510329 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=2 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:15:05.516282 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2e1efcd6-11ed-4b64-9a3e-d26cf143022f tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:05.516758 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2e1efcd6-11ed-4b64-9a3e-d26cf143022f tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:05.517528 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2e1efcd6-11ed-4b64-9a3e-d26cf143022f tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:05.517964 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2e1efcd6-11ed-4b64-9a3e-d26cf143022f tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:05.763081 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2e1efcd6-11ed-4b64-9a3e-d26cf143022f tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:15:05.770673 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2e1efcd6-11ed-4b64-9a3e-d26cf143022f tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8" status: 200 len: 1265 microversion: 2.1 time: 0.267506 Jun 08 02:15:05.771269 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 450/887] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:15:05 2022] GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8 => generated 1265 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:15:05.827987 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7d379fe5-5522-4350-9303-2a533938cff0 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:05.828623 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7d379fe5-5522-4350-9303-2a533938cff0 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 8870cf32-82de-4bee-98fd-08b49f529cf3] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:15:05.835866 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7d379fe5-5522-4350-9303-2a533938cff0 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:05.836314 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7d379fe5-5522-4350-9303-2a533938cff0 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:05.837117 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7d379fe5-5522-4350-9303-2a533938cff0 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:05.837586 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7d379fe5-5522-4350-9303-2a533938cff0 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:06.053110 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7d379fe5-5522-4350-9303-2a533938cff0 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:15:06.061213 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7d379fe5-5522-4350-9303-2a533938cff0 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3" status: 200 len: 1680 microversion: 2.1 time: 0.237155 Jun 08 02:15:06.061891 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 438/888] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:15:05 2022] GET /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3 => generated 1680 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:15:06.266079 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-4dfd7401-c5dc-49a5-97d6-e319a18bd830 req-88f90e57-cc08-4665-ba35-5d5ff52a6175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8870cf32-82de-4bee-98fd-08b49f529cf3", "name": "network-vif-deleted", "tag": "08d25dda-6fc8-4471-9351-39547da360c2"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:15:06.282624 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-4dfd7401-c5dc-49a5-97d6-e319a18bd830 req-88f90e57-cc08-4665-ba35-5d5ff52a6175 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:06.283068 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-4dfd7401-c5dc-49a5-97d6-e319a18bd830 req-88f90e57-cc08-4665-ba35-5d5ff52a6175 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:06.302384 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-4dfd7401-c5dc-49a5-97d6-e319a18bd830 req-88f90e57-cc08-4665-ba35-5d5ff52a6175 service nova] Creating event network-vif-deleted:08d25dda-6fc8-4471-9351-39547da360c2 for instance 8870cf32-82de-4bee-98fd-08b49f529cf3 on hv-cinder-84506 Jun 08 02:15:06.321353 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-4dfd7401-c5dc-49a5-97d6-e319a18bd830 req-88f90e57-cc08-4665-ba35-5d5ff52a6175 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053133 Jun 08 02:15:06.322717 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 451/889] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 02:15:06.787571 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f914010d-09e0-43a5-8fd5-22a804ffdf8f tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:06.788603 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f914010d-09e0-43a5-8fd5-22a804ffdf8f tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: d215906f-096e-4a61-8b14-8a48d6262be8] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:15:06.798680 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f914010d-09e0-43a5-8fd5-22a804ffdf8f tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:06.799268 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f914010d-09e0-43a5-8fd5-22a804ffdf8f tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:06.800679 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f914010d-09e0-43a5-8fd5-22a804ffdf8f tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:06.805082 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f914010d-09e0-43a5-8fd5-22a804ffdf8f tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:06.970939 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f914010d-09e0-43a5-8fd5-22a804ffdf8f tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:15:06.978510 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f914010d-09e0-43a5-8fd5-22a804ffdf8f tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8" status: 200 len: 1265 microversion: 2.1 time: 0.195294 Jun 08 02:15:06.979083 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 439/890] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:15:06 2022] GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8 => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:15:07.079789 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-8e57939e-1479-454c-a826-c48e120b9ac7 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:07.080527 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-8e57939e-1479-454c-a826-c48e120b9ac7 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 8870cf32-82de-4bee-98fd-08b49f529cf3] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:15:07.086792 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8e57939e-1479-454c-a826-c48e120b9ac7 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:07.087235 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8e57939e-1479-454c-a826-c48e120b9ac7 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:07.087985 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8e57939e-1479-454c-a826-c48e120b9ac7 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:07.088428 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8e57939e-1479-454c-a826-c48e120b9ac7 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:07.101289 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-8e57939e-1479-454c-a826-c48e120b9ac7 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] HTTP exception thrown: Instance 8870cf32-82de-4bee-98fd-08b49f529cf3 could not be found. Jun 08 02:15:07.102940 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-8e57939e-1479-454c-a826-c48e120b9ac7 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Request method failure captured: Jun 08 02:15:07.102940 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3 HTTP/1.1 Jun 08 02:15:07.102940 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept: application/json Jun 08 02:15:07.102940 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jun 08 02:15:07.102940 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Connection: close Jun 08 02:15:07.102940 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jun 08 02:15:07.102940 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jun 08 02:15:07.102940 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Host: 10.222.0.20 Jun 08 02:15:07.102940 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jun 08 02:15:07.102940 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jun 08 02:15:07.102940 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABioAW4IUxpz8uFDDL-2EiTBkCBex8I37pHedcb3KtOxR_5Qkw-FZcb_F__ZONQItVnmknDOkkzAj6A6u4qKVTec739oTRvutk80ABlxe7TWtEaCPh_VPhrokhrvddPC6ZdyKbKBz4FSnU6iiSRK8RTfn44nLulYip7apELdvL-QYgXa4o Jun 08 02:15:07.102940 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jun 08 02:15:07.102940 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jun 08 02:15:07.102940 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jun 08 02:15:07.102940 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jun 08 02:15:07.102940 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jun 08 02:15:07.102940 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jun 08 02:15:07.102940 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Id: 879e3eacb3bc4b69891677c86bbd5de3 Jun 08 02:15:07.102940 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:15:07.102940 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jun 08 02:15:07.102940 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jun 08 02:15:07.104537 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/879e3eacb3bc4b69891677c86bbd5de3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_879e3eacb3bc4b69891677c86bbd5de3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/879e3eacb3bc4b69891677c86bbd5de3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/879e3eacb3bc4b69891677c86bbd5de3"}]}] Jun 08 02:15:07.104537 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:15:07.104537 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 879e3eacb3bc4b69891677c86bbd5de3 Jun 08 02:15:07.104537 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:15:07.104537 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User: tempest-AttachVolumeNegativeTest-695083649-project Jun 08 02:15:07.104537 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jun 08 02:15:07.104537 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jun 08 02:15:07.104537 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Id: 92de4ab63f6447eabefe34f65c71d918 Jun 08 02:15:07.104537 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-AttachVolumeNegativeTest-695083649-project Jun 08 02:15:07.104537 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: method: > Jun 08 02:15:07.104537 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: exception: Instance 8870cf32-82de-4bee-98fd-08b49f529cf3 could not be found. Jun 08 02:15:07.104537 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: action_args: {'id': '8870cf32-82de-4bee-98fd-08b49f529cf3'} Jun 08 02:15:07.106899 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:15:07.106899 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:15:07.106899 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:15:07.106899 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:15:07.106899 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:15:07.106899 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:15:07.106899 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:15:07.106899 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:15:07.106899 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:15:07.106899 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:15:07.106899 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8870cf32-82de-4bee-98fd-08b49f529cf3 could not be found. Jun 08 02:15:07.106899 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:15:07.106899 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:15:07.106899 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:15:07.106899 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:15:07.106899 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:15:07.106899 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:15:07.106899 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:15:07.106899 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:15:07.106899 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:15:07.108535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:15:07.108535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 02:15:07.108535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 02:15:07.108535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:15:07.108535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:15:07.108535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:15:07.108535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:15:07.108535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8870cf32-82de-4bee-98fd-08b49f529cf3 could not be found. Jun 08 02:15:07.108535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:15:07.108535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:15:07.108535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:15:07.108535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:15:07.108535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:15:07.108535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:15:07.108535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:15:07.108535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:15:07.108535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8870cf32-82de-4bee-98fd-08b49f529cf3 could not be found. Jun 08 02:15:07.108535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:15:07.109877 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-8e57939e-1479-454c-a826-c48e120b9ac7 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Returning 404 to user: Instance 8870cf32-82de-4bee-98fd-08b49f529cf3 could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:15:07.109877 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-8e57939e-1479-454c-a826-c48e120b9ac7 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3" status: 404 len: 111 microversion: 2.1 time: 0.029267 Jun 08 02:15:07.109877 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 452/891] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:15:07 2022] GET /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 02:15:07.113794 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-262aa4d8-a7ce-4e5d-bf02-ffcf30dd3113 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '.version_select at 0x7f83700c6280>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:07.133946 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-262aa4d8-a7ce-4e5d-bf02-ffcf30dd3113 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1362479621" status: 202 len: 0 microversion: 2.1 time: 0.024437 Jun 08 02:15:07.134548 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 440/892] 10.222.0.20 () {58 vars in 1220 bytes} [Wed Jun 8 02:15:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1362479621 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 02:15:07.801869 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-79fed256-9396-4fd1-8c37-69379860457c tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:07.802359 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-79fed256-9396-4fd1-8c37-69379860457c tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 78009a5e-d759-4faf-8ef4-fe4d5612a690] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:15:07.808336 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-79fed256-9396-4fd1-8c37-69379860457c tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:07.808843 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-79fed256-9396-4fd1-8c37-69379860457c tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:07.809617 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-79fed256-9396-4fd1-8c37-69379860457c tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:07.810054 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-79fed256-9396-4fd1-8c37-69379860457c tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:07.888014 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.objects.instance [None req-79fed256-9396-4fd1-8c37-69379860457c tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lazy-loading 'services' on Instance uuid 78009a5e-d759-4faf-8ef4-fe4d5612a690 {{(pid=117939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 02:15:07.959811 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-79fed256-9396-4fd1-8c37-69379860457c tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "DELETE /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690/os-volume_attachments/a5bb933a-8fcd-4ba0-82c9-75d68bc13d64" status: 202 len: 0 microversion: 2.1 time: 0.161867 Jun 08 02:15:07.960440 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 453/893] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jun 8 02:15:07 2022] DELETE /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690/os-volume_attachments/a5bb933a-8fcd-4ba0-82c9-75d68bc13d64 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 02:15:07.968648 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-57d803e6-4645-4824-a2b7-b8e986ba5fd6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:07.969575 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-57d803e6-4645-4824-a2b7-b8e986ba5fd6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 78009a5e-d759-4faf-8ef4-fe4d5612a690] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:15:07.976815 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-57d803e6-4645-4824-a2b7-b8e986ba5fd6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:07.977596 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-57d803e6-4645-4824-a2b7-b8e986ba5fd6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:07.978005 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-57d803e6-4645-4824-a2b7-b8e986ba5fd6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:07.978661 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-57d803e6-4645-4824-a2b7-b8e986ba5fd6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:07.997730 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-04619ef2-08d2-47f9-a0bc-8cd6bba3ff0e tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:07.998431 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-04619ef2-08d2-47f9-a0bc-8cd6bba3ff0e tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: d215906f-096e-4a61-8b14-8a48d6262be8] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:15:08.005315 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-04619ef2-08d2-47f9-a0bc-8cd6bba3ff0e tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:08.005761 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-04619ef2-08d2-47f9-a0bc-8cd6bba3ff0e tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:08.006532 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-04619ef2-08d2-47f9-a0bc-8cd6bba3ff0e tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:08.006973 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-04619ef2-08d2-47f9-a0bc-8cd6bba3ff0e tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:08.008634 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-57d803e6-4645-4824-a2b7-b8e986ba5fd6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043922 Jun 08 02:15:08.012587 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 441/894] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jun 8 02:15:07 2022] GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:15:08.138133 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-04619ef2-08d2-47f9-a0bc-8cd6bba3ff0e tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:15:08.146527 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-04619ef2-08d2-47f9-a0bc-8cd6bba3ff0e tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8" status: 200 len: 1265 microversion: 2.1 time: 0.154752 Jun 08 02:15:08.147085 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 454/895] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:15:07 2022] GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:15:08.344048 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-ee342539-9986-4c94-ac60-a6fce53fb2c4 req-7233f6e4-8d6f-4760-9fa9-af675b0c951e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d215906f-096e-4a61-8b14-8a48d6262be8", "name": "network-vif-plugged", "status": "completed", "tag": "06b10b26-b9d9-4902-8c66-22b270f6722e"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:15:08.352903 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-ee342539-9986-4c94-ac60-a6fce53fb2c4 req-7233f6e4-8d6f-4760-9fa9-af675b0c951e service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:08.353344 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-ee342539-9986-4c94-ac60-a6fce53fb2c4 req-7233f6e4-8d6f-4760-9fa9-af675b0c951e service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:08.369552 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-ee342539-9986-4c94-ac60-a6fce53fb2c4 req-7233f6e4-8d6f-4760-9fa9-af675b0c951e service nova] Creating event network-vif-plugged:06b10b26-b9d9-4902-8c66-22b270f6722e for instance d215906f-096e-4a61-8b14-8a48d6262be8 on hv-cinder-84506 Jun 08 02:15:08.374659 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-ee342539-9986-4c94-ac60-a6fce53fb2c4 req-7233f6e4-8d6f-4760-9fa9-af675b0c951e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034278 Jun 08 02:15:08.375260 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 442/896] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:15:09.020297 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-8d0ccfd5-a4da-4ff7-bb3b-90f009b94944 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:09.021288 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-8d0ccfd5-a4da-4ff7-bb3b-90f009b94944 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 78009a5e-d759-4faf-8ef4-fe4d5612a690] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:15:09.027151 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8d0ccfd5-a4da-4ff7-bb3b-90f009b94944 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:09.027597 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8d0ccfd5-a4da-4ff7-bb3b-90f009b94944 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:09.028345 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8d0ccfd5-a4da-4ff7-bb3b-90f009b94944 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:09.028799 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8d0ccfd5-a4da-4ff7-bb3b-90f009b94944 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:09.058103 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-8d0ccfd5-a4da-4ff7-bb3b-90f009b94944 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042474 Jun 08 02:15:09.058649 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 455/897] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jun 8 02:15:09 2022] GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 08 02:15:09.115552 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5d22686f-033a-47df-9329-a50206cedd83 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:09.116129 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5d22686f-033a-47df-9329-a50206cedd83 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 78009a5e-d759-4faf-8ef4-fe4d5612a690] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:15:09.122320 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5d22686f-033a-47df-9329-a50206cedd83 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:09.122767 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5d22686f-033a-47df-9329-a50206cedd83 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:09.123519 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5d22686f-033a-47df-9329-a50206cedd83 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:09.123954 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5d22686f-033a-47df-9329-a50206cedd83 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:09.149859 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5d22686f-033a-47df-9329-a50206cedd83 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 78009a5e-d759-4faf-8ef4-fe4d5612a690] Going to try to terminate instance {{(pid=117938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 02:15:09.164147 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-4f02b470-1e87-4028-8194-c5230046c86b tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:09.164733 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-4f02b470-1e87-4028-8194-c5230046c86b tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: d215906f-096e-4a61-8b14-8a48d6262be8] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:15:09.171106 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4f02b470-1e87-4028-8194-c5230046c86b tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:09.171563 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4f02b470-1e87-4028-8194-c5230046c86b tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:09.172329 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4f02b470-1e87-4028-8194-c5230046c86b tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:09.172791 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4f02b470-1e87-4028-8194-c5230046c86b tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:09.226989 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5d22686f-033a-47df-9329-a50206cedd83 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "DELETE /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690" status: 204 len: 0 microversion: 2.1 time: 0.115557 Jun 08 02:15:09.227584 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 443/898] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jun 8 02:15:09 2022] DELETE /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 08 02:15:09.236282 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1f968650-489d-4f01-bc88-f701e05fe148 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:09.237198 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-1f968650-489d-4f01-bc88-f701e05fe148 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 78009a5e-d759-4faf-8ef4-fe4d5612a690] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:15:09.243600 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1f968650-489d-4f01-bc88-f701e05fe148 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:09.244350 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1f968650-489d-4f01-bc88-f701e05fe148 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:09.245269 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1f968650-489d-4f01-bc88-f701e05fe148 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:09.245895 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1f968650-489d-4f01-bc88-f701e05fe148 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:09.362019 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-4f02b470-1e87-4028-8194-c5230046c86b tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:15:09.369701 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-4f02b470-1e87-4028-8194-c5230046c86b tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8" status: 200 len: 1265 microversion: 2.1 time: 0.210465 Jun 08 02:15:09.370287 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 456/899] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:15:09 2022] GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8 => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:15:09.406137 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-1f968650-489d-4f01-bc88-f701e05fe148 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:15:09.415142 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1f968650-489d-4f01-bc88-f701e05fe148 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690" status: 200 len: 1681 microversion: 2.1 time: 0.182850 Jun 08 02:15:09.415632 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 444/900] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:15:09 2022] GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690 => generated 1681 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:15:10.387796 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c5370687-0ce9-4529-8b84-ab684172a94d tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:10.388604 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c5370687-0ce9-4529-8b84-ab684172a94d tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: d215906f-096e-4a61-8b14-8a48d6262be8] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:15:10.395143 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c5370687-0ce9-4529-8b84-ab684172a94d tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:10.395587 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c5370687-0ce9-4529-8b84-ab684172a94d tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:10.396351 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c5370687-0ce9-4529-8b84-ab684172a94d tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:10.396810 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c5370687-0ce9-4529-8b84-ab684172a94d tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:10.432243 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-791c12cd-e569-4d27-a8ee-495b4b72221b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:10.432909 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-791c12cd-e569-4d27-a8ee-495b4b72221b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 78009a5e-d759-4faf-8ef4-fe4d5612a690] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:15:10.439848 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-791c12cd-e569-4d27-a8ee-495b4b72221b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:10.440769 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-791c12cd-e569-4d27-a8ee-495b4b72221b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:10.441654 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-791c12cd-e569-4d27-a8ee-495b4b72221b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:10.442104 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-791c12cd-e569-4d27-a8ee-495b4b72221b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:10.575897 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c5370687-0ce9-4529-8b84-ab684172a94d tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:15:10.583954 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c5370687-0ce9-4529-8b84-ab684172a94d tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8" status: 200 len: 1265 microversion: 2.1 time: 0.199982 Jun 08 02:15:10.584552 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 457/901] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:15:10 2022] GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8 => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:15:10.606883 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-791c12cd-e569-4d27-a8ee-495b4b72221b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:15:10.614955 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-791c12cd-e569-4d27-a8ee-495b4b72221b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690" status: 200 len: 1681 microversion: 2.1 time: 0.186543 Jun 08 02:15:10.615512 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 445/902] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:15:10 2022] GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690 => generated 1681 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:15:11.600991 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-6c122ddf-8614-4902-bedf-643a5cb1e9b9 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:11.601688 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-6c122ddf-8614-4902-bedf-643a5cb1e9b9 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: d215906f-096e-4a61-8b14-8a48d6262be8] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:15:11.608736 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6c122ddf-8614-4902-bedf-643a5cb1e9b9 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:11.609282 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6c122ddf-8614-4902-bedf-643a5cb1e9b9 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:11.610153 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6c122ddf-8614-4902-bedf-643a5cb1e9b9 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:11.610659 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6c122ddf-8614-4902-bedf-643a5cb1e9b9 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:11.638402 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6cf0396e-aa08-49f0-ad72-0d785034f7ee tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:11.648184 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6cf0396e-aa08-49f0-ad72-0d785034f7ee tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 78009a5e-d759-4faf-8ef4-fe4d5612a690] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:15:11.654879 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6cf0396e-aa08-49f0-ad72-0d785034f7ee tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:11.655489 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6cf0396e-aa08-49f0-ad72-0d785034f7ee tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:11.656322 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6cf0396e-aa08-49f0-ad72-0d785034f7ee tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:11.656850 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6cf0396e-aa08-49f0-ad72-0d785034f7ee tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:11.949823 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-6c122ddf-8614-4902-bedf-643a5cb1e9b9 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:15:11.957544 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-6c122ddf-8614-4902-bedf-643a5cb1e9b9 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8" status: 200 len: 1265 microversion: 2.1 time: 0.360799 Jun 08 02:15:11.958143 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 458/903] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:15:11 2022] GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8 => generated 1265 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:15:11.963970 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6cf0396e-aa08-49f0-ad72-0d785034f7ee tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:15:11.971987 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6cf0396e-aa08-49f0-ad72-0d785034f7ee tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690" status: 200 len: 1681 microversion: 2.1 time: 0.341980 Jun 08 02:15:11.972656 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 446/904] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:15:11 2022] GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690 => generated 1681 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:15:12.341668 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-04952678-7262-4583-8bb0-016bcda1da3f req-1f4a7d67-39a4-4b43-9344-118ae32d110a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78009a5e-d759-4faf-8ef4-fe4d5612a690", "name": "network-vif-deleted", "tag": "4d3d34e3-e17d-4678-b0d8-343a5545ea95"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:15:12.354619 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-04952678-7262-4583-8bb0-016bcda1da3f req-1f4a7d67-39a4-4b43-9344-118ae32d110a service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:12.355310 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-04952678-7262-4583-8bb0-016bcda1da3f req-1f4a7d67-39a4-4b43-9344-118ae32d110a service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:12.373418 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-04952678-7262-4583-8bb0-016bcda1da3f req-1f4a7d67-39a4-4b43-9344-118ae32d110a service nova] Creating event network-vif-deleted:4d3d34e3-e17d-4678-b0d8-343a5545ea95 for instance 78009a5e-d759-4faf-8ef4-fe4d5612a690 on hv-cinder-84506 Jun 08 02:15:12.378336 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-04952678-7262-4583-8bb0-016bcda1da3f req-1f4a7d67-39a4-4b43-9344-118ae32d110a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040577 Jun 08 02:15:12.379253 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 459/905] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:15:12.974784 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e40f185d-9566-47e0-a119-a882a6eab5a5 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:12.975504 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e40f185d-9566-47e0-a119-a882a6eab5a5 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: d215906f-096e-4a61-8b14-8a48d6262be8] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:15:12.982938 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e40f185d-9566-47e0-a119-a882a6eab5a5 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:12.983695 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e40f185d-9566-47e0-a119-a882a6eab5a5 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:12.984968 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e40f185d-9566-47e0-a119-a882a6eab5a5 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:12.985603 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e40f185d-9566-47e0-a119-a882a6eab5a5 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:12.992805 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:15:12.993661 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-3fd7c606-f0d7-4eab-a0c6-074c1ddcdf70 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:12.994959 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-3fd7c606-f0d7-4eab-a0c6-074c1ddcdf70 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 78009a5e-d759-4faf-8ef4-fe4d5612a690] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:15:13.006080 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3fd7c606-f0d7-4eab-a0c6-074c1ddcdf70 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:13.006625 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3fd7c606-f0d7-4eab-a0c6-074c1ddcdf70 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:13.008274 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3fd7c606-f0d7-4eab-a0c6-074c1ddcdf70 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:13.009038 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3fd7c606-f0d7-4eab-a0c6-074c1ddcdf70 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:13.014606 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:15:13.026136 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-3fd7c606-f0d7-4eab-a0c6-074c1ddcdf70 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] HTTP exception thrown: Instance 78009a5e-d759-4faf-8ef4-fe4d5612a690 could not be found. Jun 08 02:15:13.028110 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-3fd7c606-f0d7-4eab-a0c6-074c1ddcdf70 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Request method failure captured: Jun 08 02:15:13.028110 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690 HTTP/1.1 Jun 08 02:15:13.028110 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept: application/json Jun 08 02:15:13.028110 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jun 08 02:15:13.028110 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Connection: close Jun 08 02:15:13.028110 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jun 08 02:15:13.028110 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jun 08 02:15:13.028110 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Host: 10.222.0.20 Jun 08 02:15:13.028110 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jun 08 02:15:13.028110 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jun 08 02:15:13.028110 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABioAW4IUxpz8uFDDL-2EiTBkCBex8I37pHedcb3KtOxR_5Qkw-FZcb_F__ZONQItVnmknDOkkzAj6A6u4qKVTec739oTRvutk80ABlxe7TWtEaCPh_VPhrokhrvddPC6ZdyKbKBz4FSnU6iiSRK8RTfn44nLulYip7apELdvL-QYgXa4o Jun 08 02:15:13.028110 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jun 08 02:15:13.028110 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jun 08 02:15:13.028110 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jun 08 02:15:13.028110 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jun 08 02:15:13.028110 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jun 08 02:15:13.028110 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jun 08 02:15:13.028110 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Id: 879e3eacb3bc4b69891677c86bbd5de3 Jun 08 02:15:13.028110 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:15:13.028110 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jun 08 02:15:13.028110 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jun 08 02:15:13.029615 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/879e3eacb3bc4b69891677c86bbd5de3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_879e3eacb3bc4b69891677c86bbd5de3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/879e3eacb3bc4b69891677c86bbd5de3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/879e3eacb3bc4b69891677c86bbd5de3"}]}] Jun 08 02:15:13.029615 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:15:13.029615 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 879e3eacb3bc4b69891677c86bbd5de3 Jun 08 02:15:13.029615 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:15:13.029615 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User: tempest-AttachVolumeNegativeTest-695083649-project Jun 08 02:15:13.029615 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jun 08 02:15:13.029615 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jun 08 02:15:13.029615 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Id: 92de4ab63f6447eabefe34f65c71d918 Jun 08 02:15:13.029615 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-AttachVolumeNegativeTest-695083649-project Jun 08 02:15:13.029615 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: method: > Jun 08 02:15:13.029615 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: exception: Instance 78009a5e-d759-4faf-8ef4-fe4d5612a690 could not be found. Jun 08 02:15:13.029615 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: action_args: {'id': '78009a5e-d759-4faf-8ef4-fe4d5612a690'} Jun 08 02:15:13.030522 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:15:13.030522 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:15:13.030522 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:15:13.030522 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:15:13.030522 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:15:13.030522 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:15:13.030522 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:15:13.030522 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:15:13.030522 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:15:13.030522 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:15:13.030522 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78009a5e-d759-4faf-8ef4-fe4d5612a690 could not be found. Jun 08 02:15:13.030522 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:15:13.030522 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:15:13.030522 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:15:13.030522 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:15:13.030522 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:15:13.030522 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:15:13.030522 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:15:13.030522 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:15:13.030522 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:15:13.031902 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:15:13.031902 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 02:15:13.031902 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 02:15:13.031902 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:15:13.031902 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:15:13.031902 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:15:13.031902 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:15:13.031902 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78009a5e-d759-4faf-8ef4-fe4d5612a690 could not be found. Jun 08 02:15:13.031902 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:15:13.031902 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:15:13.031902 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:15:13.031902 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:15:13.031902 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:15:13.031902 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:15:13.031902 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:15:13.031902 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:15:13.031902 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78009a5e-d759-4faf-8ef4-fe4d5612a690 could not be found. Jun 08 02:15:13.031902 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:15:13.035111 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-3fd7c606-f0d7-4eab-a0c6-074c1ddcdf70 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Returning 404 to user: Instance 78009a5e-d759-4faf-8ef4-fe4d5612a690 could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:15:13.036176 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-3fd7c606-f0d7-4eab-a0c6-074c1ddcdf70 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690" status: 404 len: 111 microversion: 2.1 time: 0.050390 Jun 08 02:15:13.037184 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 460/906] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:15:12 2022] GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 02:15:13.045842 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-66d52105-a75d-4c88-a206-2744cf38965c tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '.version_select at 0x7f836ae85e50>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:13.065429 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-66d52105-a75d-4c88-a206-2744cf38965c tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-997621325" status: 202 len: 0 microversion: 2.1 time: 0.023561 Jun 08 02:15:13.066978 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 461/907] 10.222.0.20 () {58 vars in 1217 bytes} [Wed Jun 8 02:15:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-997621325 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 08 02:15:13.140947 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e40f185d-9566-47e0-a119-a882a6eab5a5 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:15:13.149738 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e40f185d-9566-47e0-a119-a882a6eab5a5 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8" status: 200 len: 1452 microversion: 2.1 time: 0.179492 Jun 08 02:15:13.150314 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 447/908] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:15:12 2022] GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8 => generated 1452 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:15:13.165817 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c0cb6b25-306c-46bc-8689-01e8681bfad3 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:13.166427 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c0cb6b25-306c-46bc-8689-01e8681bfad3 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: d215906f-096e-4a61-8b14-8a48d6262be8] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:15:13.172673 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c0cb6b25-306c-46bc-8689-01e8681bfad3 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:13.173318 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c0cb6b25-306c-46bc-8689-01e8681bfad3 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:13.174108 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c0cb6b25-306c-46bc-8689-01e8681bfad3 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:13.174704 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c0cb6b25-306c-46bc-8689-01e8681bfad3 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:13.421976 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c0cb6b25-306c-46bc-8689-01e8681bfad3 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:15:13.430495 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c0cb6b25-306c-46bc-8689-01e8681bfad3 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8" status: 200 len: 1452 microversion: 2.1 time: 0.268717 Jun 08 02:15:13.431159 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 462/909] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:15:13 2022] GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8 => generated 1452 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:15:13.781334 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-009f1454-f533-4977-9641-cf4eafb0640a tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Action: 'create', calling method: .version_select at 0x7f836af449d0>, body: {"keypair": {"name": "tempest-keypair-8713690", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeSoLKInH95Buha7LELh/uW6SIdCCcmQVVdwWm7VGLlsl6QqGPUT5FX0yLFbLi4NBo+xApUosyjoiuUIztGPtTaZDwA3Mbk0ONqRcPqN0v8s5fNz7gcZJ4IP5ch86rYUA=="}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:15:13.796558 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-009f1454-f533-4977-9641-cf4eafb0640a tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Getting quotas for project 879e3eacb3bc4b69891677c86bbd5de3. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 02:15:13.801733 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-009f1454-f533-4977-9641-cf4eafb0640a tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Getting quotas for user 92de4ab63f6447eabefe34f65c71d918 and project 879e3eacb3bc4b69891677c86bbd5de3. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 02:15:13.825427 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-009f1454-f533-4977-9641-cf4eafb0640a tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 0.047975 Jun 08 02:15:13.826026 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 448/910] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jun 8 02:15:13 2022] POST /compute/v2.1/os-keypairs => generated 383 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:15:15.137840 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-062bff14-5dfb-4360-8c49-ceebe0dce51b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1840716889", "imageRef": "e648e482-e374-429d-8152-a4a63797f314", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ace59b46-c184-42c4-a8ec-b505d053335a"}], "security_groups": [{"name": "tempest-securitygroup--1830656413"}], "key_name": "tempest-keypair-8713690", "user_data": "}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:15:15.208306 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-28deba70-6c61-424f-83b0-28c97e910e7f req-eb7ec538-4a57-4635-841c-dc8e6278c188 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d215906f-096e-4a61-8b14-8a48d6262be8", "tag": "06b10b26-b9d9-4902-8c66-22b270f6722e"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:15:15.216457 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-28deba70-6c61-424f-83b0-28c97e910e7f req-eb7ec538-4a57-4635-841c-dc8e6278c188 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:15.216907 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-28deba70-6c61-424f-83b0-28c97e910e7f req-eb7ec538-4a57-4635-841c-dc8e6278c188 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:15.228624 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-28deba70-6c61-424f-83b0-28c97e910e7f req-eb7ec538-4a57-4635-841c-dc8e6278c188 service nova] Creating event network-changed:06b10b26-b9d9-4902-8c66-22b270f6722e for instance d215906f-096e-4a61-8b14-8a48d6262be8 on hv-cinder-84506 Jun 08 02:15:15.233578 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-28deba70-6c61-424f-83b0-28c97e910e7f req-eb7ec538-4a57-4635-841c-dc8e6278c188 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029844 Jun 08 02:15:15.234246 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 449/911] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:15:15.259763 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.network.neutron [None req-062bff14-5dfb-4360-8c49-ceebe0dce51b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] validate_networks() for [('ace59b46-c184-42c4-a8ec-b505d053335a', None, None, None, None, None)] {{(pid=117939) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 02:15:16.147197 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-062bff14-5dfb-4360-8c49-ceebe0dce51b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Flavor limits 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 02:15:16.147772 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-062bff14-5dfb-4360-8c49-ceebe0dce51b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Image limits 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 02:15:16.148080 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-062bff14-5dfb-4360-8c49-ceebe0dce51b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Flavor pref 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 02:15:16.148515 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-062bff14-5dfb-4360-8c49-ceebe0dce51b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Image pref 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 02:15:16.148948 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-062bff14-5dfb-4360-8c49-ceebe0dce51b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 02:15:16.158434 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-062bff14-5dfb-4360-8c49-ceebe0dce51b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:16.159207 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-062bff14-5dfb-4360-8c49-ceebe0dce51b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:16.160013 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-062bff14-5dfb-4360-8c49-ceebe0dce51b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:16.160479 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-062bff14-5dfb-4360-8c49-ceebe0dce51b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:16.177561 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-062bff14-5dfb-4360-8c49-ceebe0dce51b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Getting quotas for project 879e3eacb3bc4b69891677c86bbd5de3. Resources: {'cores', 'ram', 'instances'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 02:15:16.182140 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-062bff14-5dfb-4360-8c49-ceebe0dce51b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Getting quotas for user 92de4ab63f6447eabefe34f65c71d918 and project 879e3eacb3bc4b69891677c86bbd5de3. Resources: {'cores', 'ram', 'instances'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 02:15:16.196136 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-062bff14-5dfb-4360-8c49-ceebe0dce51b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Going to run 1 instances... {{(pid=117939) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 02:15:16.198521 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-062bff14-5dfb-4360-8c49-ceebe0dce51b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 9c868872-2f72-4087-a4c5-ce9521b788b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e648e482-e374-429d-8152-a4a63797f314',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 02:15:16.249772 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-062bff14-5dfb-4360-8c49-ceebe0dce51b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.116098 Jun 08 02:15:16.250423 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 463/912] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jun 8 02:15:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 1118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 08 02:15:16.262447 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b6ab54a5-8c5b-4356-9d5b-6fad4b6a089b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:16.263152 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b6ab54a5-8c5b-4356-9d5b-6fad4b6a089b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 9c868872-2f72-4087-a4c5-ce9521b788b8] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:15:16.319245 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b6ab54a5-8c5b-4356-9d5b-6fad4b6a089b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:15:16.327105 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b6ab54a5-8c5b-4356-9d5b-6fad4b6a089b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8" status: 200 len: 1239 microversion: 2.1 time: 0.069475 Jun 08 02:15:16.327756 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 450/913] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:15:16 2022] GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8 => generated 1239 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:15:17.348731 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-670f1bf5-35ad-44ce-94f7-eda7aa6c75eb tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:17.349950 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-670f1bf5-35ad-44ce-94f7-eda7aa6c75eb tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 9c868872-2f72-4087-a4c5-ce9521b788b8] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:15:17.358677 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-670f1bf5-35ad-44ce-94f7-eda7aa6c75eb tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:17.359122 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-670f1bf5-35ad-44ce-94f7-eda7aa6c75eb tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:17.359888 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-670f1bf5-35ad-44ce-94f7-eda7aa6c75eb tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:17.360319 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-670f1bf5-35ad-44ce-94f7-eda7aa6c75eb tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:17.436331 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-670f1bf5-35ad-44ce-94f7-eda7aa6c75eb tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:15:17.443968 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-670f1bf5-35ad-44ce-94f7-eda7aa6c75eb tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8" status: 200 len: 1297 microversion: 2.1 time: 0.099755 Jun 08 02:15:17.444552 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 464/914] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:15:17 2022] GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8 => generated 1297 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:15:18.461604 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a1ea094a-b127-4314-bd0b-955224faab4a tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:18.463017 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a1ea094a-b127-4314-bd0b-955224faab4a tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 9c868872-2f72-4087-a4c5-ce9521b788b8] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:15:18.473580 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a1ea094a-b127-4314-bd0b-955224faab4a tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:18.474101 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a1ea094a-b127-4314-bd0b-955224faab4a tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:18.475220 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a1ea094a-b127-4314-bd0b-955224faab4a tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:18.475871 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a1ea094a-b127-4314-bd0b-955224faab4a tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:18.659511 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-ce87165f-90ee-430d-abb8-846ed652fe3b req-9cc07247-4845-4f65-ab5d-3d081edf1765 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c868872-2f72-4087-a4c5-ce9521b788b8", "tag": "2d91729d-b2d9-4095-9424-08d2c9e7097d"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:15:18.672434 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-ce87165f-90ee-430d-abb8-846ed652fe3b req-9cc07247-4845-4f65-ab5d-3d081edf1765 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:18.673206 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-ce87165f-90ee-430d-abb8-846ed652fe3b req-9cc07247-4845-4f65-ab5d-3d081edf1765 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:18.696556 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-ce87165f-90ee-430d-abb8-846ed652fe3b req-9cc07247-4845-4f65-ab5d-3d081edf1765 service nova] Creating event network-changed:2d91729d-b2d9-4095-9424-08d2c9e7097d for instance 9c868872-2f72-4087-a4c5-ce9521b788b8 on hv-cinder-84506 Jun 08 02:15:18.701669 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-ce87165f-90ee-430d-abb8-846ed652fe3b req-9cc07247-4845-4f65-ab5d-3d081edf1765 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045941 Jun 08 02:15:18.702411 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 465/915] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 02:15:18.720871 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a1ea094a-b127-4314-bd0b-955224faab4a tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:15:18.732050 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a1ea094a-b127-4314-bd0b-955224faab4a tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8" status: 200 len: 1365 microversion: 2.1 time: 0.274310 Jun 08 02:15:18.743570 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 451/916] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:15:18 2022] GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8 => generated 1365 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:15:19.751033 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-75eedc20-46cc-4601-908a-64fa6131ad98 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:19.751722 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-75eedc20-46cc-4601-908a-64fa6131ad98 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 9c868872-2f72-4087-a4c5-ce9521b788b8] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:15:19.757935 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-75eedc20-46cc-4601-908a-64fa6131ad98 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:19.758386 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-75eedc20-46cc-4601-908a-64fa6131ad98 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:19.759141 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-75eedc20-46cc-4601-908a-64fa6131ad98 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:19.759575 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-75eedc20-46cc-4601-908a-64fa6131ad98 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:19.887814 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-75eedc20-46cc-4601-908a-64fa6131ad98 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:15:19.896721 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-75eedc20-46cc-4601-908a-64fa6131ad98 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8" status: 200 len: 1365 microversion: 2.1 time: 0.150296 Jun 08 02:15:19.897302 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 466/917] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:15:19 2022] GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:15:20.914034 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0fa9ada2-a61e-497f-b2fe-004ff1fa6284 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:20.914723 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0fa9ada2-a61e-497f-b2fe-004ff1fa6284 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 9c868872-2f72-4087-a4c5-ce9521b788b8] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:15:20.921283 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0fa9ada2-a61e-497f-b2fe-004ff1fa6284 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:20.921723 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0fa9ada2-a61e-497f-b2fe-004ff1fa6284 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:20.922471 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0fa9ada2-a61e-497f-b2fe-004ff1fa6284 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:20.922900 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0fa9ada2-a61e-497f-b2fe-004ff1fa6284 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:21.049539 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0fa9ada2-a61e-497f-b2fe-004ff1fa6284 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:15:21.057832 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0fa9ada2-a61e-497f-b2fe-004ff1fa6284 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8" status: 200 len: 1365 microversion: 2.1 time: 0.148222 Jun 08 02:15:21.058388 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 452/918] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:15:20 2022] GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:15:22.075300 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-83e47e69-d81a-428e-8283-3ade94cab535 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:22.075896 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-83e47e69-d81a-428e-8283-3ade94cab535 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 9c868872-2f72-4087-a4c5-ce9521b788b8] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:15:22.082787 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-83e47e69-d81a-428e-8283-3ade94cab535 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:22.083230 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-83e47e69-d81a-428e-8283-3ade94cab535 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:22.083976 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-83e47e69-d81a-428e-8283-3ade94cab535 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:22.084421 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-83e47e69-d81a-428e-8283-3ade94cab535 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:22.213599 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-83e47e69-d81a-428e-8283-3ade94cab535 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:15:22.221080 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-83e47e69-d81a-428e-8283-3ade94cab535 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8" status: 200 len: 1365 microversion: 2.1 time: 0.149582 Jun 08 02:15:22.221638 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 467/919] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:15:22 2022] GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:15:23.238994 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0094be62-2f42-4b00-9820-a0dc64e43e95 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:23.239535 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0094be62-2f42-4b00-9820-a0dc64e43e95 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 9c868872-2f72-4087-a4c5-ce9521b788b8] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:15:23.245964 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0094be62-2f42-4b00-9820-a0dc64e43e95 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:23.246407 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0094be62-2f42-4b00-9820-a0dc64e43e95 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:23.247156 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0094be62-2f42-4b00-9820-a0dc64e43e95 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:23.247585 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0094be62-2f42-4b00-9820-a0dc64e43e95 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:23.426800 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0094be62-2f42-4b00-9820-a0dc64e43e95 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:15:23.434187 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0094be62-2f42-4b00-9820-a0dc64e43e95 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8" status: 200 len: 1365 microversion: 2.1 time: 0.200025 Jun 08 02:15:23.434754 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 453/920] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:15:23 2022] GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8 => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:15:24.409633 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-2a52a55c-a371-4b8c-8d28-158e4516e836 req-8aebd3ce-25c3-4dc4-9afb-173a692c0a7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c868872-2f72-4087-a4c5-ce9521b788b8", "name": "network-vif-plugged", "status": "completed", "tag": "2d91729d-b2d9-4095-9424-08d2c9e7097d"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:15:24.419298 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-2a52a55c-a371-4b8c-8d28-158e4516e836 req-8aebd3ce-25c3-4dc4-9afb-173a692c0a7f service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:24.419763 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-2a52a55c-a371-4b8c-8d28-158e4516e836 req-8aebd3ce-25c3-4dc4-9afb-173a692c0a7f service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:24.432058 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-2a52a55c-a371-4b8c-8d28-158e4516e836 req-8aebd3ce-25c3-4dc4-9afb-173a692c0a7f service nova] Creating event network-vif-plugged:2d91729d-b2d9-4095-9424-08d2c9e7097d for instance 9c868872-2f72-4087-a4c5-ce9521b788b8 on hv-cinder-84506 Jun 08 02:15:24.436882 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-2a52a55c-a371-4b8c-8d28-158e4516e836 req-8aebd3ce-25c3-4dc4-9afb-173a692c0a7f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030970 Jun 08 02:15:24.437466 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 468/921] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:15:24.451049 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-be96b03c-f999-4111-a0bb-9eec2748c9dc tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:24.451664 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-be96b03c-f999-4111-a0bb-9eec2748c9dc tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 9c868872-2f72-4087-a4c5-ce9521b788b8] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:15:24.455165 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:15:24.459212 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-be96b03c-f999-4111-a0bb-9eec2748c9dc tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:24.459486 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-be96b03c-f999-4111-a0bb-9eec2748c9dc tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:24.460320 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-be96b03c-f999-4111-a0bb-9eec2748c9dc tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:24.460785 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-be96b03c-f999-4111-a0bb-9eec2748c9dc tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:24.626646 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-be96b03c-f999-4111-a0bb-9eec2748c9dc tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:15:24.635008 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-be96b03c-f999-4111-a0bb-9eec2748c9dc tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8" status: 200 len: 1365 microversion: 2.1 time: 0.187906 Jun 08 02:15:24.635717 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 454/922] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:15:24 2022] GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8 => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:15:25.653893 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e91a8f1d-f431-4c54-b67d-b8e1d4a48e74 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:25.654588 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e91a8f1d-f431-4c54-b67d-b8e1d4a48e74 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 9c868872-2f72-4087-a4c5-ce9521b788b8] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:15:25.656534 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:15:25.663922 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e91a8f1d-f431-4c54-b67d-b8e1d4a48e74 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:25.664363 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e91a8f1d-f431-4c54-b67d-b8e1d4a48e74 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:25.665146 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e91a8f1d-f431-4c54-b67d-b8e1d4a48e74 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:25.665572 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e91a8f1d-f431-4c54-b67d-b8e1d4a48e74 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:25.852160 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e91a8f1d-f431-4c54-b67d-b8e1d4a48e74 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:15:25.859574 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e91a8f1d-f431-4c54-b67d-b8e1d4a48e74 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8" status: 200 len: 1365 microversion: 2.1 time: 0.210660 Jun 08 02:15:25.860134 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 469/923] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:15:25 2022] GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8 => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:15:26.876538 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4e90e527-38a1-472f-865d-16fca99e282f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:26.877178 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4e90e527-38a1-472f-865d-16fca99e282f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 9c868872-2f72-4087-a4c5-ce9521b788b8] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:15:26.879539 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=6 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:15:26.884891 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4e90e527-38a1-472f-865d-16fca99e282f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:26.885335 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4e90e527-38a1-472f-865d-16fca99e282f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:26.886096 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4e90e527-38a1-472f-865d-16fca99e282f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:26.886572 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4e90e527-38a1-472f-865d-16fca99e282f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:27.017858 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4e90e527-38a1-472f-865d-16fca99e282f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:15:27.026357 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4e90e527-38a1-472f-865d-16fca99e282f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8" status: 200 len: 1554 microversion: 2.1 time: 0.153360 Jun 08 02:15:27.027367 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 455/924] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:15:26 2022] GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:15:27.044032 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-80dd98d5-f1ed-4b40-8134-dce9cf3ddf8d tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:15:27.044586 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-80dd98d5-f1ed-4b40-8134-dce9cf3ddf8d tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 9c868872-2f72-4087-a4c5-ce9521b788b8] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:15:27.046444 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=2 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:15:27.047259 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=6 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:15:27.053647 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-80dd98d5-f1ed-4b40-8134-dce9cf3ddf8d tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:27.054097 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-80dd98d5-f1ed-4b40-8134-dce9cf3ddf8d tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:27.054863 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-80dd98d5-f1ed-4b40-8134-dce9cf3ddf8d tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:27.055301 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-80dd98d5-f1ed-4b40-8134-dce9cf3ddf8d tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:27.130034 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-80dd98d5-f1ed-4b40-8134-dce9cf3ddf8d tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089793 Jun 08 02:15:27.130626 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 470/925] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jun 8 02:15:27 2022] GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:15:28.034709 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-3fa06d8c-0531-4190-8443-e623d25f2c67 req-76673ac5-2313-4988-b5a4-360b57086fac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c868872-2f72-4087-a4c5-ce9521b788b8", "tag": "2d91729d-b2d9-4095-9424-08d2c9e7097d"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:15:28.048356 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-3fa06d8c-0531-4190-8443-e623d25f2c67 req-76673ac5-2313-4988-b5a4-360b57086fac service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:15:28.048832 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-3fa06d8c-0531-4190-8443-e623d25f2c67 req-76673ac5-2313-4988-b5a4-360b57086fac service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:15:28.062775 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-3fa06d8c-0531-4190-8443-e623d25f2c67 req-76673ac5-2313-4988-b5a4-360b57086fac service nova] Creating event network-changed:2d91729d-b2d9-4095-9424-08d2c9e7097d for instance 9c868872-2f72-4087-a4c5-ce9521b788b8 on hv-cinder-84506 Jun 08 02:15:28.068082 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-3fa06d8c-0531-4190-8443-e623d25f2c67 req-76673ac5-2313-4988-b5a4-360b57086fac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037060 Jun 08 02:15:28.068903 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 456/926] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:16:04.175729 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=3 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:16:04.176614 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=40 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:16:04.181520 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-679be069-e686-45a9-a7b2-14b6f7e23647 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:16:04.182011 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-679be069-e686-45a9-a7b2-14b6f7e23647 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 9c868872-2f72-4087-a4c5-ce9521b788b8] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:16:04.188708 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-679be069-e686-45a9-a7b2-14b6f7e23647 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:04.189157 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-679be069-e686-45a9-a7b2-14b6f7e23647 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:04.189913 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-679be069-e686-45a9-a7b2-14b6f7e23647 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:04.190343 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-679be069-e686-45a9-a7b2-14b6f7e23647 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:04.212757 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-679be069-e686-45a9-a7b2-14b6f7e23647 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8/ips" status: 200 len: 149 microversion: 2.1 time: 0.038355 Jun 08 02:16:04.213307 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 471/927] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Jun 8 02:16:04 2022] GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:16:05.533218 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4a2a991a-a91c-434c-b1ae-03c9c9e06d8e tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68f39453-7aea-48cc-840a-22a8bde76b5a"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:16:05.534370 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4a2a991a-a91c-434c-b1ae-03c9c9e06d8e tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 9c868872-2f72-4087-a4c5-ce9521b788b8] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:16:05.536556 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=5 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:16:05.537304 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=38 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:16:05.543702 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4a2a991a-a91c-434c-b1ae-03c9c9e06d8e tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:05.544150 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4a2a991a-a91c-434c-b1ae-03c9c9e06d8e tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:05.545048 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4a2a991a-a91c-434c-b1ae-03c9c9e06d8e tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:05.545487 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4a2a991a-a91c-434c-b1ae-03c9c9e06d8e tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:05.777876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4a2a991a-a91c-434c-b1ae-03c9c9e06d8e tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "POST /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.248987 Jun 08 02:16:05.778480 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 457/928] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jun 8 02:16:05 2022] POST /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8/os-volume_attachments => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:16:13.267545 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ee71d227-cb9a-424c-a3bb-445c309b5804 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68f39453-7aea-48cc-840a-22a8bde76b5a"}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:16:13.268668 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ee71d227-cb9a-424c-a3bb-445c309b5804 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 9c868872-2f72-4087-a4c5-ce9521b788b8] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:16:13.274657 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ee71d227-cb9a-424c-a3bb-445c309b5804 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:13.275114 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ee71d227-cb9a-424c-a3bb-445c309b5804 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:13.275868 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ee71d227-cb9a-424c-a3bb-445c309b5804 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:13.276301 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ee71d227-cb9a-424c-a3bb-445c309b5804 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:13.354428 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-ee71d227-cb9a-424c-a3bb-445c309b5804 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] HTTP exception thrown: Invalid volume: volume 68f39453-7aea-48cc-840a-22a8bde76b5a is already attached to instances: 9c868872-2f72-4087-a4c5-ce9521b788b8 Jun 08 02:16:13.356168 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ee71d227-cb9a-424c-a3bb-445c309b5804 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Request method failure captured: Jun 08 02:16:13.356168 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: request: POST /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8/os-volume_attachments HTTP/1.1 Jun 08 02:16:13.356168 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept: application/json Jun 08 02:16:13.356168 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jun 08 02:16:13.356168 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Connection: close Jun 08 02:16:13.356168 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Length: 74 Jun 08 02:16:13.356168 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jun 08 02:16:13.356168 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Host: 10.222.0.20 Jun 08 02:16:13.356168 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jun 08 02:16:13.356168 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jun 08 02:16:13.356168 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABioAW4IUxpz8uFDDL-2EiTBkCBex8I37pHedcb3KtOxR_5Qkw-FZcb_F__ZONQItVnmknDOkkzAj6A6u4qKVTec739oTRvutk80ABlxe7TWtEaCPh_VPhrokhrvddPC6ZdyKbKBz4FSnU6iiSRK8RTfn44nLulYip7apELdvL-QYgXa4o Jun 08 02:16:13.356168 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jun 08 02:16:13.356168 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jun 08 02:16:13.356168 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jun 08 02:16:13.356168 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jun 08 02:16:13.356168 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jun 08 02:16:13.356168 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jun 08 02:16:13.356168 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Id: 879e3eacb3bc4b69891677c86bbd5de3 Jun 08 02:16:13.356168 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:16:13.356168 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jun 08 02:16:13.356168 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jun 08 02:16:13.357788 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/879e3eacb3bc4b69891677c86bbd5de3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_879e3eacb3bc4b69891677c86bbd5de3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/879e3eacb3bc4b69891677c86bbd5de3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/879e3eacb3bc4b69891677c86bbd5de3"}]}] Jun 08 02:16:13.357788 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:16:13.357788 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 879e3eacb3bc4b69891677c86bbd5de3 Jun 08 02:16:13.357788 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:16:13.357788 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User: tempest-AttachVolumeNegativeTest-695083649-project Jun 08 02:16:13.357788 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jun 08 02:16:13.357788 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jun 08 02:16:13.357788 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Id: 92de4ab63f6447eabefe34f65c71d918 Jun 08 02:16:13.357788 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-AttachVolumeNegativeTest-695083649-project Jun 08 02:16:13.357788 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Jun 08 02:16:13.357788 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: {"volumeAttachment": {"volumeId": "68f39453-7aea-48cc-840a-22a8bde76b5a"}} Jun 08 02:16:13.357788 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: method: > Jun 08 02:16:13.358971 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: exception: Invalid volume: volume 68f39453-7aea-48cc-840a-22a8bde76b5a is already attached to instances: 9c868872-2f72-4087-a4c5-ce9521b788b8 Jun 08 02:16:13.358971 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: action_args: {'server_id': '9c868872-2f72-4087-a4c5-ce9521b788b8', 'body': {'volumeAttachment': {'volumeId': '68f39453-7aea-48cc-840a-22a8bde76b5a'}}} Jun 08 02:16:13.358971 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:16:13.358971 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:16:13.358971 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 08 02:16:13.358971 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 08 02:16:13.358971 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 08 02:16:13.358971 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 08 02:16:13.358971 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 08 02:16:13.358971 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 08 02:16:13.358971 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 08 02:16:13.358971 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 08 02:16:13.358971 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 08 02:16:13.358971 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 08 02:16:13.358971 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 68f39453-7aea-48cc-840a-22a8bde76b5a is already attached to instances: 9c868872-2f72-4087-a4c5-ce9521b788b8 Jun 08 02:16:13.358971 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:16:13.358971 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:16:13.358971 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:16:13.358971 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:16:13.360258 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:16:13.360258 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:16:13.360258 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:16:13.360258 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:16:13.360258 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:16:13.360258 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:16:13.360258 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 08 02:16:13.360258 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 08 02:16:13.360258 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 08 02:16:13.360258 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 08 02:16:13.360258 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 08 02:16:13.360258 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 08 02:16:13.360258 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 08 02:16:13.360258 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 08 02:16:13.360258 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 68f39453-7aea-48cc-840a-22a8bde76b5a is already attached to instances: 9c868872-2f72-4087-a4c5-ce9521b788b8 Jun 08 02:16:13.360258 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:16:13.360258 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:16:13.360258 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:16:13.360258 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:16:13.360258 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:16:13.362820 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:16:13.362820 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:16:13.362820 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:16:13.362820 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 68f39453-7aea-48cc-840a-22a8bde76b5a is already attached to instances: 9c868872-2f72-4087-a4c5-ce9521b788b8 Jun 08 02:16:13.362820 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:16:13.362820 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ee71d227-cb9a-424c-a3bb-445c309b5804 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Returning 400 to user: Invalid volume: volume 68f39453-7aea-48cc-840a-22a8bde76b5a is already attached to instances: 9c868872-2f72-4087-a4c5-ce9521b788b8 {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:16:13.362820 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ee71d227-cb9a-424c-a3bb-445c309b5804 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "POST /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094291 Jun 08 02:16:13.362820 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 472/929] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jun 8 02:16:13 2022] POST /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 08 02:16:13.421888 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9cf10adc-fdad-413c-a1fa-b6c2ede401db tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:16:13.422429 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9cf10adc-fdad-413c-a1fa-b6c2ede401db tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 9c868872-2f72-4087-a4c5-ce9521b788b8] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:16:13.428733 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9cf10adc-fdad-413c-a1fa-b6c2ede401db tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:13.429180 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9cf10adc-fdad-413c-a1fa-b6c2ede401db tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:13.429942 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9cf10adc-fdad-413c-a1fa-b6c2ede401db tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:13.430380 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9cf10adc-fdad-413c-a1fa-b6c2ede401db tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:13.511016 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-9cf10adc-fdad-413c-a1fa-b6c2ede401db tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lazy-loading 'services' on Instance uuid 9c868872-2f72-4087-a4c5-ce9521b788b8 {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 02:16:13.581093 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9cf10adc-fdad-413c-a1fa-b6c2ede401db tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8/os-volume_attachments/68f39453-7aea-48cc-840a-22a8bde76b5a" status: 202 len: 0 microversion: 2.1 time: 0.163779 Jun 08 02:16:13.581668 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 458/930] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jun 8 02:16:13 2022] DELETE /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8/os-volume_attachments/68f39453-7aea-48cc-840a-22a8bde76b5a => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 08 02:16:13.589995 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0ae2a9bb-ffab-4fd1-86d2-0e1b05199821 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:16:13.590941 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-0ae2a9bb-ffab-4fd1-86d2-0e1b05199821 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 9c868872-2f72-4087-a4c5-ce9521b788b8] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:16:13.598008 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0ae2a9bb-ffab-4fd1-86d2-0e1b05199821 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:13.598781 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0ae2a9bb-ffab-4fd1-86d2-0e1b05199821 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:13.599619 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0ae2a9bb-ffab-4fd1-86d2-0e1b05199821 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:13.600077 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0ae2a9bb-ffab-4fd1-86d2-0e1b05199821 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:13.632183 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-0ae2a9bb-ffab-4fd1-86d2-0e1b05199821 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046094 Jun 08 02:16:13.632765 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 473/931] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jun 8 02:16:13 2022] GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:16:14.644730 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1778c6ef-e47f-4791-8b13-9f717d39d506 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:16:14.645852 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-1778c6ef-e47f-4791-8b13-9f717d39d506 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 9c868872-2f72-4087-a4c5-ce9521b788b8] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:16:14.653082 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1778c6ef-e47f-4791-8b13-9f717d39d506 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:14.653529 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1778c6ef-e47f-4791-8b13-9f717d39d506 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:14.654291 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1778c6ef-e47f-4791-8b13-9f717d39d506 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:14.654754 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1778c6ef-e47f-4791-8b13-9f717d39d506 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:14.683489 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1778c6ef-e47f-4791-8b13-9f717d39d506 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043517 Jun 08 02:16:14.684038 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 459/932] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jun 8 02:16:14 2022] GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 08 02:16:14.745529 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-8f892ec7-71b3-4dc5-a55b-8602e2b4b42e tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:16:14.746048 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-8f892ec7-71b3-4dc5-a55b-8602e2b4b42e tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 9c868872-2f72-4087-a4c5-ce9521b788b8] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:16:14.752674 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8f892ec7-71b3-4dc5-a55b-8602e2b4b42e tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:14.753123 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8f892ec7-71b3-4dc5-a55b-8602e2b4b42e tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:14.753877 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8f892ec7-71b3-4dc5-a55b-8602e2b4b42e tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:14.754311 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8f892ec7-71b3-4dc5-a55b-8602e2b4b42e tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:14.779520 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-8f892ec7-71b3-4dc5-a55b-8602e2b4b42e tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 9c868872-2f72-4087-a4c5-ce9521b788b8] Going to try to terminate instance {{(pid=117939) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 02:16:14.853472 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-8f892ec7-71b3-4dc5-a55b-8602e2b4b42e tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8" status: 204 len: 0 microversion: 2.1 time: 0.111542 Jun 08 02:16:14.854119 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 474/933] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jun 8 02:16:14 2022] DELETE /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 08 02:16:14.862604 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5877b6a1-6f36-4f4c-9483-ce26543e9f03 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:16:14.863258 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5877b6a1-6f36-4f4c-9483-ce26543e9f03 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 9c868872-2f72-4087-a4c5-ce9521b788b8] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:16:14.869368 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5877b6a1-6f36-4f4c-9483-ce26543e9f03 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:14.869817 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5877b6a1-6f36-4f4c-9483-ce26543e9f03 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:14.870620 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5877b6a1-6f36-4f4c-9483-ce26543e9f03 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:14.871056 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5877b6a1-6f36-4f4c-9483-ce26543e9f03 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:15.246217 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5877b6a1-6f36-4f4c-9483-ce26543e9f03 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:16:15.253927 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5877b6a1-6f36-4f4c-9483-ce26543e9f03 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8" status: 200 len: 1679 microversion: 2.1 time: 0.395336 Jun 08 02:16:15.254661 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 460/934] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:16:14 2022] GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8 => generated 1679 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:16:16.272202 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b62a9660-211b-41ca-b3a3-13fafed99ba1 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:16:16.272929 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-b62a9660-211b-41ca-b3a3-13fafed99ba1 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 9c868872-2f72-4087-a4c5-ce9521b788b8] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:16:16.279312 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b62a9660-211b-41ca-b3a3-13fafed99ba1 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:16.279762 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b62a9660-211b-41ca-b3a3-13fafed99ba1 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:16.280540 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b62a9660-211b-41ca-b3a3-13fafed99ba1 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:16.280972 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b62a9660-211b-41ca-b3a3-13fafed99ba1 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:16.408263 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b62a9660-211b-41ca-b3a3-13fafed99ba1 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:16:16.416949 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-b62a9660-211b-41ca-b3a3-13fafed99ba1 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8" status: 200 len: 1679 microversion: 2.1 time: 0.149560 Jun 08 02:16:16.417514 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 475/935] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:16:16 2022] GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:16:17.441387 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-deb6d05f-2526-47dc-b438-02f2237e54ed tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:16:17.442888 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-deb6d05f-2526-47dc-b438-02f2237e54ed tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 9c868872-2f72-4087-a4c5-ce9521b788b8] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:16:17.457909 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-deb6d05f-2526-47dc-b438-02f2237e54ed tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:17.458673 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-deb6d05f-2526-47dc-b438-02f2237e54ed tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:17.460061 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-deb6d05f-2526-47dc-b438-02f2237e54ed tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:17.461048 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-deb6d05f-2526-47dc-b438-02f2237e54ed tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:17.487322 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-9825de7c-a460-45a0-a5e7-275eabfeb7ad req-e68cffb2-a37f-447b-8ac3-412308a888a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c868872-2f72-4087-a4c5-ce9521b788b8", "name": "network-vif-deleted", "tag": "2d91729d-b2d9-4095-9424-08d2c9e7097d"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:16:17.498116 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-9825de7c-a460-45a0-a5e7-275eabfeb7ad req-e68cffb2-a37f-447b-8ac3-412308a888a0 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:17.498884 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-9825de7c-a460-45a0-a5e7-275eabfeb7ad req-e68cffb2-a37f-447b-8ac3-412308a888a0 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:17.514380 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-9825de7c-a460-45a0-a5e7-275eabfeb7ad req-e68cffb2-a37f-447b-8ac3-412308a888a0 service nova] Creating event network-vif-deleted:2d91729d-b2d9-4095-9424-08d2c9e7097d for instance 9c868872-2f72-4087-a4c5-ce9521b788b8 on hv-cinder-84506 Jun 08 02:16:17.519971 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-9825de7c-a460-45a0-a5e7-275eabfeb7ad req-e68cffb2-a37f-447b-8ac3-412308a888a0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120967 Jun 08 02:16:17.521189 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 461/936] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:16:17.570010 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-deb6d05f-2526-47dc-b438-02f2237e54ed tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:16:17.581575 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-deb6d05f-2526-47dc-b438-02f2237e54ed tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8" status: 200 len: 1324 microversion: 2.1 time: 0.148765 Jun 08 02:16:17.582916 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 476/937] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:16:17 2022] GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8 => generated 1324 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:16:18.600296 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-91b0f54a-f52e-4490-bcf4-bf1cac996096 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:16:18.601022 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-91b0f54a-f52e-4490-bcf4-bf1cac996096 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 9c868872-2f72-4087-a4c5-ce9521b788b8] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:16:18.607370 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-91b0f54a-f52e-4490-bcf4-bf1cac996096 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:18.607756 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-91b0f54a-f52e-4490-bcf4-bf1cac996096 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:18.608602 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-91b0f54a-f52e-4490-bcf4-bf1cac996096 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:18.609042 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-91b0f54a-f52e-4490-bcf4-bf1cac996096 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:18.625745 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-91b0f54a-f52e-4490-bcf4-bf1cac996096 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] HTTP exception thrown: Instance 9c868872-2f72-4087-a4c5-ce9521b788b8 could not be found. Jun 08 02:16:18.627388 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-91b0f54a-f52e-4490-bcf4-bf1cac996096 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Request method failure captured: Jun 08 02:16:18.627388 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8 HTTP/1.1 Jun 08 02:16:18.627388 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept: application/json Jun 08 02:16:18.627388 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jun 08 02:16:18.627388 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Connection: close Jun 08 02:16:18.627388 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jun 08 02:16:18.627388 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jun 08 02:16:18.627388 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Host: 10.222.0.20 Jun 08 02:16:18.627388 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jun 08 02:16:18.627388 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jun 08 02:16:18.627388 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABioAW4IUxpz8uFDDL-2EiTBkCBex8I37pHedcb3KtOxR_5Qkw-FZcb_F__ZONQItVnmknDOkkzAj6A6u4qKVTec739oTRvutk80ABlxe7TWtEaCPh_VPhrokhrvddPC6ZdyKbKBz4FSnU6iiSRK8RTfn44nLulYip7apELdvL-QYgXa4o Jun 08 02:16:18.627388 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jun 08 02:16:18.627388 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jun 08 02:16:18.627388 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jun 08 02:16:18.627388 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jun 08 02:16:18.627388 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jun 08 02:16:18.627388 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jun 08 02:16:18.627388 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Id: 879e3eacb3bc4b69891677c86bbd5de3 Jun 08 02:16:18.627388 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:16:18.627388 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jun 08 02:16:18.627388 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jun 08 02:16:18.629179 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/879e3eacb3bc4b69891677c86bbd5de3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_879e3eacb3bc4b69891677c86bbd5de3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/879e3eacb3bc4b69891677c86bbd5de3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/879e3eacb3bc4b69891677c86bbd5de3"}]}] Jun 08 02:16:18.629179 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:16:18.629179 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 879e3eacb3bc4b69891677c86bbd5de3 Jun 08 02:16:18.629179 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:16:18.629179 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeNegativeTest-695083649-project Jun 08 02:16:18.629179 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jun 08 02:16:18.629179 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jun 08 02:16:18.629179 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Id: 92de4ab63f6447eabefe34f65c71d918 Jun 08 02:16:18.629179 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeNegativeTest-695083649-project Jun 08 02:16:18.629179 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: method: > Jun 08 02:16:18.629179 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: exception: Instance 9c868872-2f72-4087-a4c5-ce9521b788b8 could not be found. Jun 08 02:16:18.629179 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: action_args: {'id': '9c868872-2f72-4087-a4c5-ce9521b788b8'} Jun 08 02:16:18.630014 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:16:18.630014 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:16:18.630014 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:16:18.630014 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:16:18.630014 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:16:18.630014 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:16:18.630014 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:16:18.630014 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:16:18.630014 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:16:18.630014 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:16:18.630014 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c868872-2f72-4087-a4c5-ce9521b788b8 could not be found. Jun 08 02:16:18.630014 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:16:18.630014 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:16:18.630014 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:16:18.630014 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:16:18.630014 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:16:18.630014 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:16:18.630014 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:16:18.630014 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:16:18.630014 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:16:18.631526 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:16:18.631526 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 02:16:18.631526 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 02:16:18.631526 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:16:18.631526 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:16:18.631526 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:16:18.631526 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:16:18.631526 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c868872-2f72-4087-a4c5-ce9521b788b8 could not be found. Jun 08 02:16:18.631526 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:16:18.631526 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:16:18.631526 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:16:18.631526 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:16:18.631526 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:16:18.631526 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:16:18.631526 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:16:18.631526 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:16:18.631526 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c868872-2f72-4087-a4c5-ce9521b788b8 could not be found. Jun 08 02:16:18.631526 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:16:18.632896 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-91b0f54a-f52e-4490-bcf4-bf1cac996096 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Returning 404 to user: Instance 9c868872-2f72-4087-a4c5-ce9521b788b8 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:16:18.632896 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-91b0f54a-f52e-4490-bcf4-bf1cac996096 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8" status: 404 len: 111 microversion: 2.1 time: 0.033713 Jun 08 02:16:18.632896 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 462/938] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:16:18 2022] GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 02:16:18.637878 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-7db7ad99-4d29-42ad-a75b-990ec01ad05a tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '.version_select at 0x7f8370089dc0>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:16:18.655204 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-7db7ad99-4d29-42ad-a75b-990ec01ad05a tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-8713690" status: 202 len: 0 microversion: 2.1 time: 0.021093 Jun 08 02:16:18.655769 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 477/939] 10.222.0.20 () {58 vars in 1211 bytes} [Wed Jun 8 02:16:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-8713690 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 02:16:19.253969 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b4014113-c587-463a-9519-98c8a7e8d488 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Action: 'create', calling method: .version_select at 0x7f83700db8b0>, body: {"keypair": {"name": "tempest-keypair-145314380", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNT1l+duxNyhkbk+dIdEfSeSC4d1R7O5RQZjDN6VAsQrbkYfa1iPojW4YqouJVwqDociynmpjlR3OBISIyyMe1O+4t2PLamDKRdBeRhgq3fKm5Jj4LgsyNMtyPos923vng=="}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:16:19.270967 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-b4014113-c587-463a-9519-98c8a7e8d488 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Getting quotas for project 879e3eacb3bc4b69891677c86bbd5de3. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 02:16:19.275925 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-b4014113-c587-463a-9519-98c8a7e8d488 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Getting quotas for user 92de4ab63f6447eabefe34f65c71d918 and project 879e3eacb3bc4b69891677c86bbd5de3. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 02:16:19.304169 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b4014113-c587-463a-9519-98c8a7e8d488 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.056135 Jun 08 02:16:19.304793 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 463/940] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jun 8 02:16:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:16:20.546530 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-9f6eae04-838b-42ca-8258-12040b89c2b9 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-526315525", "imageRef": "e648e482-e374-429d-8152-a4a63797f314", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ace59b46-c184-42c4-a8ec-b505d053335a"}], "security_groups": [{"name": "tempest-securitygroup--1606403381"}], "key_name": "tempest-keypair-145314380", "user_data": "}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:16:20.646294 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.network.neutron [None req-9f6eae04-838b-42ca-8258-12040b89c2b9 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] validate_networks() for [('ace59b46-c184-42c4-a8ec-b505d053335a', None, None, None, None, None)] {{(pid=117939) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 02:16:21.028878 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-9f6eae04-838b-42ca-8258-12040b89c2b9 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Flavor limits 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 02:16:21.029298 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-9f6eae04-838b-42ca-8258-12040b89c2b9 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Image limits 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 02:16:21.029767 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-9f6eae04-838b-42ca-8258-12040b89c2b9 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Flavor pref 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 02:16:21.030171 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-9f6eae04-838b-42ca-8258-12040b89c2b9 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Image pref 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 02:16:21.030605 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-9f6eae04-838b-42ca-8258-12040b89c2b9 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 02:16:21.039713 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9f6eae04-838b-42ca-8258-12040b89c2b9 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:21.040140 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9f6eae04-838b-42ca-8258-12040b89c2b9 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:21.040962 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9f6eae04-838b-42ca-8258-12040b89c2b9 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:21.041397 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9f6eae04-838b-42ca-8258-12040b89c2b9 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:21.058290 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-9f6eae04-838b-42ca-8258-12040b89c2b9 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Getting quotas for project 879e3eacb3bc4b69891677c86bbd5de3. Resources: {'cores', 'ram', 'instances'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 02:16:21.062223 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-9f6eae04-838b-42ca-8258-12040b89c2b9 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Getting quotas for user 92de4ab63f6447eabefe34f65c71d918 and project 879e3eacb3bc4b69891677c86bbd5de3. Resources: {'cores', 'ram', 'instances'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 02:16:21.073581 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-9f6eae04-838b-42ca-8258-12040b89c2b9 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Going to run 1 instances... {{(pid=117939) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 02:16:21.075786 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-9f6eae04-838b-42ca-8258-12040b89c2b9 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 6e4df138-a844-4517-b90d-e9834f10ba81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e648e482-e374-429d-8152-a4a63797f314',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 02:16:21.121768 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-9f6eae04-838b-42ca-8258-12040b89c2b9 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.580038 Jun 08 02:16:21.122409 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 478/941] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jun 8 02:16:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 08 02:16:21.133114 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-367a2e8a-2289-4f67-9ce1-e4e7c72b12f3 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:16:21.133721 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-367a2e8a-2289-4f67-9ce1-e4e7c72b12f3 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 6e4df138-a844-4517-b90d-e9834f10ba81] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:16:21.192858 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-367a2e8a-2289-4f67-9ce1-e4e7c72b12f3 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:16:21.200249 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-367a2e8a-2289-4f67-9ce1-e4e7c72b12f3 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81" status: 200 len: 1240 microversion: 2.1 time: 0.071810 Jun 08 02:16:21.200835 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 464/942] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:16:21 2022] GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81 => generated 1240 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:16:22.217466 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b1afd383-dd25-46c4-a3ba-ae2fa391ac58 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:16:22.218730 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-b1afd383-dd25-46c4-a3ba-ae2fa391ac58 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 6e4df138-a844-4517-b90d-e9834f10ba81] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:16:22.227186 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b1afd383-dd25-46c4-a3ba-ae2fa391ac58 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:22.229047 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b1afd383-dd25-46c4-a3ba-ae2fa391ac58 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:22.229846 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b1afd383-dd25-46c4-a3ba-ae2fa391ac58 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:22.230286 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b1afd383-dd25-46c4-a3ba-ae2fa391ac58 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:22.312077 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b1afd383-dd25-46c4-a3ba-ae2fa391ac58 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:16:22.320042 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-b1afd383-dd25-46c4-a3ba-ae2fa391ac58 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81" status: 200 len: 1310 microversion: 2.1 time: 0.106465 Jun 08 02:16:22.320860 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 479/943] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:16:22 2022] GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81 => generated 1310 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:16:23.337555 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-789fee0a-05ad-4374-8d4c-801c757f5d9b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:16:23.338141 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-789fee0a-05ad-4374-8d4c-801c757f5d9b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 6e4df138-a844-4517-b90d-e9834f10ba81] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:16:23.344370 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-789fee0a-05ad-4374-8d4c-801c757f5d9b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:23.344859 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-789fee0a-05ad-4374-8d4c-801c757f5d9b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:23.345617 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-789fee0a-05ad-4374-8d4c-801c757f5d9b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:23.346047 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-789fee0a-05ad-4374-8d4c-801c757f5d9b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:23.566131 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-789fee0a-05ad-4374-8d4c-801c757f5d9b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:16:23.580386 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-789fee0a-05ad-4374-8d4c-801c757f5d9b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81" status: 200 len: 1366 microversion: 2.1 time: 0.247093 Jun 08 02:16:23.581020 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 465/944] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:16:23 2022] GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81 => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:16:23.769040 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-8a466820-509e-46d2-812c-a14bdcdf2799 req-4880568c-372b-4648-8945-5291e21e07b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e4df138-a844-4517-b90d-e9834f10ba81", "tag": "cc2bb239-d2d8-428f-b312-59fce54f851d"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:16:23.785428 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-8a466820-509e-46d2-812c-a14bdcdf2799 req-4880568c-372b-4648-8945-5291e21e07b3 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:23.786638 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-8a466820-509e-46d2-812c-a14bdcdf2799 req-4880568c-372b-4648-8945-5291e21e07b3 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:23.817732 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-8a466820-509e-46d2-812c-a14bdcdf2799 req-4880568c-372b-4648-8945-5291e21e07b3 service nova] Creating event network-changed:cc2bb239-d2d8-428f-b312-59fce54f851d for instance 6e4df138-a844-4517-b90d-e9834f10ba81 on hv-cinder-84506 Jun 08 02:16:23.823890 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-8a466820-509e-46d2-812c-a14bdcdf2799 req-4880568c-372b-4648-8945-5291e21e07b3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058669 Jun 08 02:16:23.824947 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 480/945] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:16:24.597215 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-de36f3e3-1e59-4367-8adc-90e6fa9a1f6f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:16:24.597826 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-de36f3e3-1e59-4367-8adc-90e6fa9a1f6f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 6e4df138-a844-4517-b90d-e9834f10ba81] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:16:24.604835 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-de36f3e3-1e59-4367-8adc-90e6fa9a1f6f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:24.605285 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-de36f3e3-1e59-4367-8adc-90e6fa9a1f6f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:24.606054 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-de36f3e3-1e59-4367-8adc-90e6fa9a1f6f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:24.606494 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-de36f3e3-1e59-4367-8adc-90e6fa9a1f6f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:24.736712 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-de36f3e3-1e59-4367-8adc-90e6fa9a1f6f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:16:24.744609 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-de36f3e3-1e59-4367-8adc-90e6fa9a1f6f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81" status: 200 len: 1366 microversion: 2.1 time: 0.151249 Jun 08 02:16:24.745170 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 466/946] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:16:24 2022] GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:16:25.762307 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-04d923ca-9635-4950-9203-6369aaf81767 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:16:25.763012 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-04d923ca-9635-4950-9203-6369aaf81767 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 6e4df138-a844-4517-b90d-e9834f10ba81] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:16:25.769334 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-04d923ca-9635-4950-9203-6369aaf81767 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:25.769887 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-04d923ca-9635-4950-9203-6369aaf81767 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:25.770775 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-04d923ca-9635-4950-9203-6369aaf81767 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:25.771264 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-04d923ca-9635-4950-9203-6369aaf81767 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:25.899950 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-04d923ca-9635-4950-9203-6369aaf81767 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:16:25.907397 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-04d923ca-9635-4950-9203-6369aaf81767 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81" status: 200 len: 1366 microversion: 2.1 time: 0.149894 Jun 08 02:16:25.907955 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 481/947] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:16:25 2022] GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:16:26.924705 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2c342e47-a589-4e11-8ea8-80fa1f3a52e8 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:16:26.925408 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2c342e47-a589-4e11-8ea8-80fa1f3a52e8 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 6e4df138-a844-4517-b90d-e9834f10ba81] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:16:26.932953 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2c342e47-a589-4e11-8ea8-80fa1f3a52e8 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:26.933407 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2c342e47-a589-4e11-8ea8-80fa1f3a52e8 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:26.934180 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2c342e47-a589-4e11-8ea8-80fa1f3a52e8 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:26.934620 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2c342e47-a589-4e11-8ea8-80fa1f3a52e8 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:27.077817 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2c342e47-a589-4e11-8ea8-80fa1f3a52e8 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:16:27.085692 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2c342e47-a589-4e11-8ea8-80fa1f3a52e8 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81" status: 200 len: 1366 microversion: 2.1 time: 0.164998 Jun 08 02:16:27.094919 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 467/948] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:16:26 2022] GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:16:28.102752 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-1759b079-f884-4c61-b519-5e00332c9069 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:16:28.103359 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-1759b079-f884-4c61-b519-5e00332c9069 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 6e4df138-a844-4517-b90d-e9834f10ba81] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:16:28.109834 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1759b079-f884-4c61-b519-5e00332c9069 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:28.110281 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1759b079-f884-4c61-b519-5e00332c9069 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:28.111035 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1759b079-f884-4c61-b519-5e00332c9069 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:28.111464 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1759b079-f884-4c61-b519-5e00332c9069 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:28.237584 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1759b079-f884-4c61-b519-5e00332c9069 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:16:28.245776 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-1759b079-f884-4c61-b519-5e00332c9069 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81" status: 200 len: 1366 microversion: 2.1 time: 0.147393 Jun 08 02:16:28.246335 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 482/949] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:16:28 2022] GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:16:28.792011 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-da3daff1-30c6-4014-a124-139da790a100 req-6d12e6c3-fbe4-4b80-9caf-92cb2a49e670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e4df138-a844-4517-b90d-e9834f10ba81", "name": "network-vif-plugged", "status": "completed", "tag": "cc2bb239-d2d8-428f-b312-59fce54f851d"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:16:28.801175 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-da3daff1-30c6-4014-a124-139da790a100 req-6d12e6c3-fbe4-4b80-9caf-92cb2a49e670 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:28.802295 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-da3daff1-30c6-4014-a124-139da790a100 req-6d12e6c3-fbe4-4b80-9caf-92cb2a49e670 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:28.813189 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-da3daff1-30c6-4014-a124-139da790a100 req-6d12e6c3-fbe4-4b80-9caf-92cb2a49e670 service nova] Creating event network-vif-plugged:cc2bb239-d2d8-428f-b312-59fce54f851d for instance 6e4df138-a844-4517-b90d-e9834f10ba81 on hv-cinder-84506 Jun 08 02:16:28.817993 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-da3daff1-30c6-4014-a124-139da790a100 req-6d12e6c3-fbe4-4b80-9caf-92cb2a49e670 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088441 Jun 08 02:16:28.819151 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 468/950] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:16:29.262497 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-9f547ef2-d9d2-423d-9f54-2a6c3218b21e tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:16:29.263103 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-9f547ef2-d9d2-423d-9f54-2a6c3218b21e tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 6e4df138-a844-4517-b90d-e9834f10ba81] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:16:29.269502 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9f547ef2-d9d2-423d-9f54-2a6c3218b21e tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:29.269948 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9f547ef2-d9d2-423d-9f54-2a6c3218b21e tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:29.270697 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9f547ef2-d9d2-423d-9f54-2a6c3218b21e tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:29.271129 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9f547ef2-d9d2-423d-9f54-2a6c3218b21e tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:29.396813 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-9f547ef2-d9d2-423d-9f54-2a6c3218b21e tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:16:29.404219 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-9f547ef2-d9d2-423d-9f54-2a6c3218b21e tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81" status: 200 len: 1366 microversion: 2.1 time: 0.145555 Jun 08 02:16:29.404805 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 483/951] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:16:29 2022] GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:16:30.422657 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-27db7295-4fc0-429c-92a6-4b6c8259c0d1 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:16:30.423347 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-27db7295-4fc0-429c-92a6-4b6c8259c0d1 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 6e4df138-a844-4517-b90d-e9834f10ba81] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:16:30.430269 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-27db7295-4fc0-429c-92a6-4b6c8259c0d1 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:30.430713 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-27db7295-4fc0-429c-92a6-4b6c8259c0d1 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:30.431462 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-27db7295-4fc0-429c-92a6-4b6c8259c0d1 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:30.431893 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-27db7295-4fc0-429c-92a6-4b6c8259c0d1 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:30.561996 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-27db7295-4fc0-429c-92a6-4b6c8259c0d1 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:16:30.569514 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-27db7295-4fc0-429c-92a6-4b6c8259c0d1 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81" status: 200 len: 1366 microversion: 2.1 time: 0.151573 Jun 08 02:16:30.570105 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 469/952] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:16:30 2022] GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:16:31.586143 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c50cd4c6-1c3e-4201-9de6-af812550734c tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:16:31.586758 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c50cd4c6-1c3e-4201-9de6-af812550734c tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 6e4df138-a844-4517-b90d-e9834f10ba81] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:16:31.589195 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=2 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:16:31.589911 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=6 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:16:31.595696 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c50cd4c6-1c3e-4201-9de6-af812550734c tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:31.596148 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c50cd4c6-1c3e-4201-9de6-af812550734c tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:31.596989 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c50cd4c6-1c3e-4201-9de6-af812550734c tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:31.597381 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c50cd4c6-1c3e-4201-9de6-af812550734c tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:31.726798 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c50cd4c6-1c3e-4201-9de6-af812550734c tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:16:31.734139 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c50cd4c6-1c3e-4201-9de6-af812550734c tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81" status: 200 len: 1556 microversion: 2.1 time: 0.151833 Jun 08 02:16:31.734698 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 484/953] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:16:31 2022] GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81 => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:16:31.750693 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6e2c0152-08d7-4394-8519-7fcc8efafc6e tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:16:31.751198 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6e2c0152-08d7-4394-8519-7fcc8efafc6e tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 6e4df138-a844-4517-b90d-e9834f10ba81] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:16:31.753154 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=6 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:16:31.759374 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6e2c0152-08d7-4394-8519-7fcc8efafc6e tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:31.759822 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6e2c0152-08d7-4394-8519-7fcc8efafc6e tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:31.760623 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6e2c0152-08d7-4394-8519-7fcc8efafc6e tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:31.761062 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6e2c0152-08d7-4394-8519-7fcc8efafc6e tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:31.837788 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6e2c0152-08d7-4394-8519-7fcc8efafc6e tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090946 Jun 08 02:16:31.838385 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 470/954] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jun 8 02:16:31 2022] GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:16:32.983237 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-6f08527c-87a2-4c1f-bbe8-7083015fe887 req-ab17bade-7bba-47cc-b548-a9dc53ce0533 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e4df138-a844-4517-b90d-e9834f10ba81", "tag": "cc2bb239-d2d8-428f-b312-59fce54f851d"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:16:32.993483 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-6f08527c-87a2-4c1f-bbe8-7083015fe887 req-ab17bade-7bba-47cc-b548-a9dc53ce0533 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:16:32.993997 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-6f08527c-87a2-4c1f-bbe8-7083015fe887 req-ab17bade-7bba-47cc-b548-a9dc53ce0533 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:16:33.006308 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-6f08527c-87a2-4c1f-bbe8-7083015fe887 req-ab17bade-7bba-47cc-b548-a9dc53ce0533 service nova] Creating event network-changed:cc2bb239-d2d8-428f-b312-59fce54f851d for instance 6e4df138-a844-4517-b90d-e9834f10ba81 on hv-cinder-84506 Jun 08 02:16:33.011497 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-6f08527c-87a2-4c1f-bbe8-7083015fe887 req-ab17bade-7bba-47cc-b548-a9dc53ce0533 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031868 Jun 08 02:16:33.012174 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 485/955] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 02:17:08.867539 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:17:08.868336 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:17:08.872353 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f7ca09ea-b15f-4116-89b4-75406fdedd95 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:08.872865 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f7ca09ea-b15f-4116-89b4-75406fdedd95 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 6e4df138-a844-4517-b90d-e9834f10ba81] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:08.881334 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f7ca09ea-b15f-4116-89b4-75406fdedd95 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:08.881782 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f7ca09ea-b15f-4116-89b4-75406fdedd95 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:08.882539 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f7ca09ea-b15f-4116-89b4-75406fdedd95 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:08.882969 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f7ca09ea-b15f-4116-89b4-75406fdedd95 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:08.907305 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f7ca09ea-b15f-4116-89b4-75406fdedd95 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81/ips" status: 200 len: 149 microversion: 2.1 time: 0.041219 Jun 08 02:17:08.907876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 471/956] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Jun 8 02:17:08 2022] GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:17:10.220419 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:17:10.221187 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:17:10.225790 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-dc7e7e33-1947-4544-b226-ff7ec22ef830 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd6a81b7-e909-4b72-8053-cfeb2346b222"}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:17:10.226937 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-dc7e7e33-1947-4544-b226-ff7ec22ef830 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 6e4df138-a844-4517-b90d-e9834f10ba81] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:10.235378 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-dc7e7e33-1947-4544-b226-ff7ec22ef830 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:10.235829 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-dc7e7e33-1947-4544-b226-ff7ec22ef830 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:10.236632 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-dc7e7e33-1947-4544-b226-ff7ec22ef830 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:10.237078 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-dc7e7e33-1947-4544-b226-ff7ec22ef830 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:10.440069 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8cbbeb83-5759-4a80-bff6-da01ae24b9e1 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:10.440664 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8cbbeb83-5759-4a80-bff6-da01ae24b9e1 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: d215906f-096e-4a61-8b14-8a48d6262be8] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:10.447373 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8cbbeb83-5759-4a80-bff6-da01ae24b9e1 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:10.448043 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8cbbeb83-5759-4a80-bff6-da01ae24b9e1 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:10.448718 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8cbbeb83-5759-4a80-bff6-da01ae24b9e1 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:10.449337 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8cbbeb83-5759-4a80-bff6-da01ae24b9e1 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:10.475002 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8cbbeb83-5759-4a80-bff6-da01ae24b9e1 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: d215906f-096e-4a61-8b14-8a48d6262be8] Going to try to terminate instance {{(pid=117938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 02:17:10.487711 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-dc7e7e33-1947-4544-b226-ff7ec22ef830 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "POST /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268592 Jun 08 02:17:10.488598 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 486/957] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jun 8 02:17:10 2022] POST /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:17:10.563827 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8cbbeb83-5759-4a80-bff6-da01ae24b9e1 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8" status: 204 len: 0 microversion: 2.1 time: 0.127428 Jun 08 02:17:10.564419 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 472/958] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jun 8 02:17:10 2022] DELETE /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 08 02:17:10.574752 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2d12c312-abe0-46b2-b480-ecf1087c501e tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:10.575457 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-2d12c312-abe0-46b2-b480-ecf1087c501e tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: d215906f-096e-4a61-8b14-8a48d6262be8] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:10.583263 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2d12c312-abe0-46b2-b480-ecf1087c501e tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:10.584364 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2d12c312-abe0-46b2-b480-ecf1087c501e tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:10.585206 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2d12c312-abe0-46b2-b480-ecf1087c501e tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:10.585893 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2d12c312-abe0-46b2-b480-ecf1087c501e tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:10.718848 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2d12c312-abe0-46b2-b480-ecf1087c501e tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:17:10.726277 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2d12c312-abe0-46b2-b480-ecf1087c501e tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8" status: 200 len: 1577 microversion: 2.1 time: 0.157546 Jun 08 02:17:10.726860 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 487/959] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:17:10 2022] GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:17:11.744807 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-23d50917-f3a2-4cec-bc19-ae7169c687be tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:11.745502 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-23d50917-f3a2-4cec-bc19-ae7169c687be tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: d215906f-096e-4a61-8b14-8a48d6262be8] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:11.751878 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-23d50917-f3a2-4cec-bc19-ae7169c687be tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:11.752325 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-23d50917-f3a2-4cec-bc19-ae7169c687be tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:11.753110 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-23d50917-f3a2-4cec-bc19-ae7169c687be tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:11.753543 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-23d50917-f3a2-4cec-bc19-ae7169c687be tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:11.883353 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-23d50917-f3a2-4cec-bc19-ae7169c687be tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:17:11.891001 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-23d50917-f3a2-4cec-bc19-ae7169c687be tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8" status: 200 len: 1577 microversion: 2.1 time: 0.150952 Jun 08 02:17:11.891883 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 473/960] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:17:11 2022] GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:17:12.910941 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-82f07166-0b9f-4b19-9a67-ddbbcf6aa5ed tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:12.911555 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-82f07166-0b9f-4b19-9a67-ddbbcf6aa5ed tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: d215906f-096e-4a61-8b14-8a48d6262be8] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:12.919868 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-82f07166-0b9f-4b19-9a67-ddbbcf6aa5ed tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:12.920349 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-82f07166-0b9f-4b19-9a67-ddbbcf6aa5ed tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:12.921191 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-82f07166-0b9f-4b19-9a67-ddbbcf6aa5ed tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:12.928592 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-82f07166-0b9f-4b19-9a67-ddbbcf6aa5ed tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:13.023807 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-82f07166-0b9f-4b19-9a67-ddbbcf6aa5ed tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:17:13.032722 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-82f07166-0b9f-4b19-9a67-ddbbcf6aa5ed tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8" status: 200 len: 1509 microversion: 2.1 time: 0.128220 Jun 08 02:17:13.033310 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 488/961] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:17:12 2022] GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8 => generated 1509 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:17:13.209366 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-da7bfdc2-49dc-45eb-aa3b-3dbf971c8ab1 req-fa09fc2a-450c-4b6b-8e40-f292991deea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d215906f-096e-4a61-8b14-8a48d6262be8", "name": "network-vif-deleted", "tag": "06b10b26-b9d9-4902-8c66-22b270f6722e"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:17:13.218693 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-da7bfdc2-49dc-45eb-aa3b-3dbf971c8ab1 req-fa09fc2a-450c-4b6b-8e40-f292991deea3 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:13.219203 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-da7bfdc2-49dc-45eb-aa3b-3dbf971c8ab1 req-fa09fc2a-450c-4b6b-8e40-f292991deea3 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:13.231456 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-da7bfdc2-49dc-45eb-aa3b-3dbf971c8ab1 req-fa09fc2a-450c-4b6b-8e40-f292991deea3 service nova] Creating event network-vif-deleted:06b10b26-b9d9-4902-8c66-22b270f6722e for instance d215906f-096e-4a61-8b14-8a48d6262be8 on hv-cinder-84506 Jun 08 02:17:13.237260 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-da7bfdc2-49dc-45eb-aa3b-3dbf971c8ab1 req-fa09fc2a-450c-4b6b-8e40-f292991deea3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031284 Jun 08 02:17:13.238177 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 474/962] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:17:14.051274 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-39bfffb4-564d-4dee-89ae-19aae47f70a7 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:14.051818 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-39bfffb4-564d-4dee-89ae-19aae47f70a7 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: d215906f-096e-4a61-8b14-8a48d6262be8] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:14.059018 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-39bfffb4-564d-4dee-89ae-19aae47f70a7 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:14.059466 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-39bfffb4-564d-4dee-89ae-19aae47f70a7 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:14.060256 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-39bfffb4-564d-4dee-89ae-19aae47f70a7 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:14.060731 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-39bfffb4-564d-4dee-89ae-19aae47f70a7 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:14.075168 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-39bfffb4-564d-4dee-89ae-19aae47f70a7 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] HTTP exception thrown: Instance d215906f-096e-4a61-8b14-8a48d6262be8 could not be found. Jun 08 02:17:14.076838 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-39bfffb4-564d-4dee-89ae-19aae47f70a7 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Request method failure captured: Jun 08 02:17:14.076838 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8 HTTP/1.1 Jun 08 02:17:14.076838 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept: application/json Jun 08 02:17:14.076838 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jun 08 02:17:14.076838 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Connection: close Jun 08 02:17:14.076838 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jun 08 02:17:14.076838 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jun 08 02:17:14.076838 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Host: 10.222.0.20 Jun 08 02:17:14.076838 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jun 08 02:17:14.076838 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jun 08 02:17:14.076838 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABioAYH8SHHbdNBHiVHcXBGVStClglw5a4JEvFcPW2GsCVERWsVVZqTAOCTt2e95x2vEzJT1mnnHK5HDYAVInYtGbv3SWDkZ5gjFo8776zOXBAXMm_E5zGV74Y0y74yKsiL3el-2yuGx4vgog4eFmp3UvHCROakMycgbtnhHUg6cC5EG3A Jun 08 02:17:14.076838 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jun 08 02:17:14.076838 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jun 08 02:17:14.076838 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jun 08 02:17:14.076838 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jun 08 02:17:14.076838 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jun 08 02:17:14.076838 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jun 08 02:17:14.076838 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Id: 079027b24aba4a179f99de9f6fe944b8 Jun 08 02:17:14.076838 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-TestVolumeBootPattern-515964686 Jun 08 02:17:14.076838 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jun 08 02:17:14.076838 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jun 08 02:17:14.078645 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/079027b24aba4a179f99de9f6fe944b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_079027b24aba4a179f99de9f6fe944b8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/079027b24aba4a179f99de9f6fe944b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/079027b24aba4a179f99de9f6fe944b8"}]}] Jun 08 02:17:14.078645 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-TestVolumeBootPattern-515964686 Jun 08 02:17:14.078645 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 079027b24aba4a179f99de9f6fe944b8 Jun 08 02:17:14.078645 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-TestVolumeBootPattern-515964686 Jun 08 02:17:14.078645 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User: tempest-TestVolumeBootPattern-515964686-project Jun 08 02:17:14.078645 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jun 08 02:17:14.078645 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jun 08 02:17:14.078645 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Id: 89e6c19fcc9f490c890fc4d6350273a0 Jun 08 02:17:14.078645 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-TestVolumeBootPattern-515964686-project Jun 08 02:17:14.078645 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: method: > Jun 08 02:17:14.078645 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: exception: Instance d215906f-096e-4a61-8b14-8a48d6262be8 could not be found. Jun 08 02:17:14.078645 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: action_args: {'id': 'd215906f-096e-4a61-8b14-8a48d6262be8'} Jun 08 02:17:14.079506 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:17:14.079506 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:17:14.079506 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:17:14.079506 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:17:14.079506 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:17:14.079506 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:17:14.079506 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:17:14.079506 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:17:14.079506 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:17:14.079506 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:17:14.079506 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d215906f-096e-4a61-8b14-8a48d6262be8 could not be found. Jun 08 02:17:14.079506 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:17:14.079506 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:17:14.079506 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:17:14.079506 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:17:14.079506 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:17:14.079506 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:17:14.079506 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:17:14.079506 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:17:14.079506 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:17:14.080904 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:17:14.080904 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 02:17:14.080904 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 02:17:14.080904 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:17:14.080904 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:17:14.080904 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:17:14.080904 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:17:14.080904 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d215906f-096e-4a61-8b14-8a48d6262be8 could not be found. Jun 08 02:17:14.080904 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:17:14.080904 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:17:14.080904 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:17:14.080904 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:17:14.080904 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:17:14.080904 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:17:14.080904 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:17:14.080904 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:17:14.080904 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d215906f-096e-4a61-8b14-8a48d6262be8 could not be found. Jun 08 02:17:14.080904 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:17:14.082077 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-39bfffb4-564d-4dee-89ae-19aae47f70a7 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Returning 404 to user: Instance d215906f-096e-4a61-8b14-8a48d6262be8 could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:17:14.082077 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-39bfffb4-564d-4dee-89ae-19aae47f70a7 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8" status: 404 len: 111 microversion: 2.1 time: 0.031025 Jun 08 02:17:14.082077 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 489/963] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:17:14 2022] GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 02:17:14.155537 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-49ecfea1-93bf-4e58-a0cf-8632465c3291 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-694182388", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-153398192", "security_groups": [{"name": "tempest-secgroup-smoke-1399273772"}], "block_device_mapping_v2": [{"uuid": "e62d09e1-f36c-4c88-ab91-a0f29e785fcc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "05318a5a-b32e-458e-9f7c-d5bc705960a2"}]}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:17:14.267886 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.network.neutron [None req-49ecfea1-93bf-4e58-a0cf-8632465c3291 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] validate_networks() for [('05318a5a-b32e-458e-9f7c-d5bc705960a2', None, None, None, None, None)] {{(pid=117938) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 02:17:14.706836 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-49ecfea1-93bf-4e58-a0cf-8632465c3291 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Flavor limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 02:17:14.707255 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-49ecfea1-93bf-4e58-a0cf-8632465c3291 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Image limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 02:17:14.707731 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-49ecfea1-93bf-4e58-a0cf-8632465c3291 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Flavor pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 02:17:14.708168 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-49ecfea1-93bf-4e58-a0cf-8632465c3291 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Image pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 02:17:14.708606 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-49ecfea1-93bf-4e58-a0cf-8632465c3291 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 02:17:14.717755 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-49ecfea1-93bf-4e58-a0cf-8632465c3291 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:14.718267 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-49ecfea1-93bf-4e58-a0cf-8632465c3291 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:14.719085 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-49ecfea1-93bf-4e58-a0cf-8632465c3291 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:14.719451 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-49ecfea1-93bf-4e58-a0cf-8632465c3291 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:14.736635 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-49ecfea1-93bf-4e58-a0cf-8632465c3291 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Getting quotas for project 079027b24aba4a179f99de9f6fe944b8. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 02:17:14.740513 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-49ecfea1-93bf-4e58-a0cf-8632465c3291 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Getting quotas for user 89e6c19fcc9f490c890fc4d6350273a0 and project 079027b24aba4a179f99de9f6fe944b8. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 02:17:14.798071 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-49ecfea1-93bf-4e58-a0cf-8632465c3291 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Going to run 1 instances... {{(pid=117938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 02:17:14.800459 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-49ecfea1-93bf-4e58-a0cf-8632465c3291 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e62d09e1-f36c-4c88-ab91-a0f29e785fcc',volume_size=None,volume_type=None)] {{(pid=117938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 02:17:14.935174 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-49ecfea1-93bf-4e58-a0cf-8632465c3291 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.783973 Jun 08 02:17:14.935818 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 475/964] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jun 8 02:17:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 08 02:17:14.945751 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2d493585-0f4c-4762-a030-5357cfcc446c tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:14.946443 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-2d493585-0f4c-4762-a030-5357cfcc446c tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:14.999594 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2d493585-0f4c-4762-a030-5357cfcc446c tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:17:15.006358 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2d493585-0f4c-4762-a030-5357cfcc446c tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de" status: 200 len: 1093 microversion: 2.1 time: 0.064542 Jun 08 02:17:15.006916 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 490/965] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:17:14 2022] GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:17:16.024151 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c9c2ddb8-c54e-446e-b1d9-6d8402bf30bc tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:16.025671 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c9c2ddb8-c54e-446e-b1d9-6d8402bf30bc tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:16.032598 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c9c2ddb8-c54e-446e-b1d9-6d8402bf30bc tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:16.033043 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c9c2ddb8-c54e-446e-b1d9-6d8402bf30bc tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:16.033808 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c9c2ddb8-c54e-446e-b1d9-6d8402bf30bc tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:16.034240 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c9c2ddb8-c54e-446e-b1d9-6d8402bf30bc tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:16.101549 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c9c2ddb8-c54e-446e-b1d9-6d8402bf30bc tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:17:16.109045 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c9c2ddb8-c54e-446e-b1d9-6d8402bf30bc tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de" status: 200 len: 1209 microversion: 2.1 time: 0.089796 Jun 08 02:17:16.109610 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 476/966] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:17:16 2022] GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de => generated 1209 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:17:17.126134 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-bdb1e7ed-cb75-43d5-9eb6-e3f0633253ac tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:17.126696 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-bdb1e7ed-cb75-43d5-9eb6-e3f0633253ac tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:17.133958 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bdb1e7ed-cb75-43d5-9eb6-e3f0633253ac tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:17.134425 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bdb1e7ed-cb75-43d5-9eb6-e3f0633253ac tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:17.135356 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bdb1e7ed-cb75-43d5-9eb6-e3f0633253ac tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:17.135800 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bdb1e7ed-cb75-43d5-9eb6-e3f0633253ac tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:17.328803 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-bdb1e7ed-cb75-43d5-9eb6-e3f0633253ac tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:17:17.338690 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-bdb1e7ed-cb75-43d5-9eb6-e3f0633253ac tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de" status: 200 len: 1277 microversion: 2.1 time: 0.215559 Jun 08 02:17:17.339283 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 491/967] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:17:17 2022] GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de => generated 1277 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:17:17.564894 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-d98231ed-646d-45f4-a6ac-e1bc95fd501e req-9276d558-77e9-4db4-8772-40f74ae79717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de", "tag": "32f4531c-b75e-4816-9d56-731d8bac1cd2"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:17:17.577078 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-d98231ed-646d-45f4-a6ac-e1bc95fd501e req-9276d558-77e9-4db4-8772-40f74ae79717 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:17.577662 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-d98231ed-646d-45f4-a6ac-e1bc95fd501e req-9276d558-77e9-4db4-8772-40f74ae79717 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:17.589739 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-d98231ed-646d-45f4-a6ac-e1bc95fd501e req-9276d558-77e9-4db4-8772-40f74ae79717 service nova] Creating event network-changed:32f4531c-b75e-4816-9d56-731d8bac1cd2 for instance ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de on hv-cinder-84506 Jun 08 02:17:17.594910 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-d98231ed-646d-45f4-a6ac-e1bc95fd501e req-9276d558-77e9-4db4-8772-40f74ae79717 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035287 Jun 08 02:17:17.595488 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 477/968] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:17:18.355632 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-985821ed-65d9-4514-bf60-f1e728bb2a9c tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:18.356240 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-985821ed-65d9-4514-bf60-f1e728bb2a9c tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:18.362761 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-985821ed-65d9-4514-bf60-f1e728bb2a9c tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:18.363217 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-985821ed-65d9-4514-bf60-f1e728bb2a9c tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:18.363993 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-985821ed-65d9-4514-bf60-f1e728bb2a9c tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:18.364454 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-985821ed-65d9-4514-bf60-f1e728bb2a9c tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:18.573450 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-985821ed-65d9-4514-bf60-f1e728bb2a9c tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:17:18.581984 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-985821ed-65d9-4514-bf60-f1e728bb2a9c tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de" status: 200 len: 1277 microversion: 2.1 time: 0.230662 Jun 08 02:17:18.582711 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 492/969] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:17:18 2022] GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de => generated 1277 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:17:19.140577 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e50aa491-95ec-4863-8f33-dd54b7a6f983 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:19.141156 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e50aa491-95ec-4863-8f33-dd54b7a6f983 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 6e4df138-a844-4517-b90d-e9834f10ba81] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:19.147299 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e50aa491-95ec-4863-8f33-dd54b7a6f983 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:19.147742 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e50aa491-95ec-4863-8f33-dd54b7a6f983 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:19.148538 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e50aa491-95ec-4863-8f33-dd54b7a6f983 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:19.148973 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e50aa491-95ec-4863-8f33-dd54b7a6f983 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:19.229295 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-e50aa491-95ec-4863-8f33-dd54b7a6f983 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lazy-loading 'services' on Instance uuid 6e4df138-a844-4517-b90d-e9834f10ba81 {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 02:17:19.299301 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e50aa491-95ec-4863-8f33-dd54b7a6f983 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81/os-volume_attachments/fd6a81b7-e909-4b72-8053-cfeb2346b222" status: 202 len: 0 microversion: 2.1 time: 0.163540 Jun 08 02:17:19.299879 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 478/970] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jun 8 02:17:19 2022] DELETE /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81/os-volume_attachments/fd6a81b7-e909-4b72-8053-cfeb2346b222 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 02:17:19.308803 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-92153ad1-98a4-4d2f-940c-bfbdd86ea10f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:19.309788 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-92153ad1-98a4-4d2f-940c-bfbdd86ea10f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 6e4df138-a844-4517-b90d-e9834f10ba81] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:19.315812 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-92153ad1-98a4-4d2f-940c-bfbdd86ea10f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:19.316259 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-92153ad1-98a4-4d2f-940c-bfbdd86ea10f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:19.317067 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-92153ad1-98a4-4d2f-940c-bfbdd86ea10f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:19.317504 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-92153ad1-98a4-4d2f-940c-bfbdd86ea10f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:19.347708 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-92153ad1-98a4-4d2f-940c-bfbdd86ea10f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043433 Jun 08 02:17:19.348262 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 493/971] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jun 8 02:17:19 2022] GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:17:19.599421 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6afef36d-e1ca-4fa7-b06f-67510bad4ed7 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:19.600118 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6afef36d-e1ca-4fa7-b06f-67510bad4ed7 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:19.606836 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6afef36d-e1ca-4fa7-b06f-67510bad4ed7 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:19.607284 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6afef36d-e1ca-4fa7-b06f-67510bad4ed7 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:19.608042 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6afef36d-e1ca-4fa7-b06f-67510bad4ed7 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:19.608502 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6afef36d-e1ca-4fa7-b06f-67510bad4ed7 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:19.738488 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6afef36d-e1ca-4fa7-b06f-67510bad4ed7 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:17:19.746312 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6afef36d-e1ca-4fa7-b06f-67510bad4ed7 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de" status: 200 len: 1265 microversion: 2.1 time: 0.151032 Jun 08 02:17:19.746878 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 479/972] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:17:19 2022] GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:17:20.360138 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-855911c0-132c-41e5-8dc1-9aa42ee5113b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:20.361091 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-855911c0-132c-41e5-8dc1-9aa42ee5113b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 6e4df138-a844-4517-b90d-e9834f10ba81] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:20.367743 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-855911c0-132c-41e5-8dc1-9aa42ee5113b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:20.368189 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-855911c0-132c-41e5-8dc1-9aa42ee5113b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:20.369002 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-855911c0-132c-41e5-8dc1-9aa42ee5113b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:20.369581 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-855911c0-132c-41e5-8dc1-9aa42ee5113b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:20.397660 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-855911c0-132c-41e5-8dc1-9aa42ee5113b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041543 Jun 08 02:17:20.398202 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 494/973] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jun 8 02:17:20 2022] GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 08 02:17:20.454988 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e340e7ba-f37c-443b-8c62-0376612c4f8f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:20.455512 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e340e7ba-f37c-443b-8c62-0376612c4f8f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 6e4df138-a844-4517-b90d-e9834f10ba81] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:20.461882 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e340e7ba-f37c-443b-8c62-0376612c4f8f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:20.462324 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e340e7ba-f37c-443b-8c62-0376612c4f8f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:20.464286 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e340e7ba-f37c-443b-8c62-0376612c4f8f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:20.464746 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e340e7ba-f37c-443b-8c62-0376612c4f8f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:20.490730 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e340e7ba-f37c-443b-8c62-0376612c4f8f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 6e4df138-a844-4517-b90d-e9834f10ba81] Going to try to terminate instance {{(pid=117938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 02:17:20.566744 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e340e7ba-f37c-443b-8c62-0376612c4f8f tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81" status: 204 len: 0 microversion: 2.1 time: 0.115287 Jun 08 02:17:20.567324 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 480/974] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jun 8 02:17:20 2022] DELETE /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 08 02:17:20.575895 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-cbd37444-9b03-42a5-aeb5-56bb9523e262 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:20.576528 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-cbd37444-9b03-42a5-aeb5-56bb9523e262 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 6e4df138-a844-4517-b90d-e9834f10ba81] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:20.582401 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cbd37444-9b03-42a5-aeb5-56bb9523e262 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:20.582840 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cbd37444-9b03-42a5-aeb5-56bb9523e262 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:20.583588 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cbd37444-9b03-42a5-aeb5-56bb9523e262 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:20.584018 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cbd37444-9b03-42a5-aeb5-56bb9523e262 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:20.709612 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-cbd37444-9b03-42a5-aeb5-56bb9523e262 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:17:20.717535 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-cbd37444-9b03-42a5-aeb5-56bb9523e262 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81" status: 200 len: 1680 microversion: 2.1 time: 0.145955 Jun 08 02:17:20.718107 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 495/975] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:17:20 2022] GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81 => generated 1680 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:17:20.764656 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7c14b132-ec79-4415-a8e3-175ed023091c tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:20.765347 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7c14b132-ec79-4415-a8e3-175ed023091c tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:20.772972 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7c14b132-ec79-4415-a8e3-175ed023091c tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:20.773783 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7c14b132-ec79-4415-a8e3-175ed023091c tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:20.774878 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7c14b132-ec79-4415-a8e3-175ed023091c tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:20.775382 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7c14b132-ec79-4415-a8e3-175ed023091c tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:20.924212 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7c14b132-ec79-4415-a8e3-175ed023091c tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:17:20.933034 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7c14b132-ec79-4415-a8e3-175ed023091c tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de" status: 200 len: 1265 microversion: 2.1 time: 0.173140 Jun 08 02:17:20.933720 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 481/976] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:17:20 2022] GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:17:21.734995 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-962ac244-93fa-4f8a-b6ae-7f70be11f7ea tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:21.735663 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-962ac244-93fa-4f8a-b6ae-7f70be11f7ea tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 6e4df138-a844-4517-b90d-e9834f10ba81] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:21.742241 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-962ac244-93fa-4f8a-b6ae-7f70be11f7ea tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:21.742685 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-962ac244-93fa-4f8a-b6ae-7f70be11f7ea tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:21.743435 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-962ac244-93fa-4f8a-b6ae-7f70be11f7ea tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:21.743866 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-962ac244-93fa-4f8a-b6ae-7f70be11f7ea tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:21.873237 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-962ac244-93fa-4f8a-b6ae-7f70be11f7ea tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:17:21.880733 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-962ac244-93fa-4f8a-b6ae-7f70be11f7ea tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81" status: 200 len: 1680 microversion: 2.1 time: 0.149467 Jun 08 02:17:21.884300 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 496/977] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:17:21 2022] GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:17:21.950370 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a54103fe-9c7d-4fbb-bb38-7ac8c84ada1d tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:21.951001 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a54103fe-9c7d-4fbb-bb38-7ac8c84ada1d tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:21.957391 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a54103fe-9c7d-4fbb-bb38-7ac8c84ada1d tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:21.957830 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a54103fe-9c7d-4fbb-bb38-7ac8c84ada1d tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:21.958584 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a54103fe-9c7d-4fbb-bb38-7ac8c84ada1d tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:21.959010 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a54103fe-9c7d-4fbb-bb38-7ac8c84ada1d tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:22.107368 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a54103fe-9c7d-4fbb-bb38-7ac8c84ada1d tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:17:22.115043 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a54103fe-9c7d-4fbb-bb38-7ac8c84ada1d tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de" status: 200 len: 1265 microversion: 2.1 time: 0.169028 Jun 08 02:17:22.115594 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 482/978] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:17:21 2022] GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:17:22.901715 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-6ec977b5-60e4-40c1-8135-23546a82957a tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:22.902347 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-6ec977b5-60e4-40c1-8135-23546a82957a tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 6e4df138-a844-4517-b90d-e9834f10ba81] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:22.922758 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6ec977b5-60e4-40c1-8135-23546a82957a tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:22.923205 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6ec977b5-60e4-40c1-8135-23546a82957a tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:22.927739 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6ec977b5-60e4-40c1-8135-23546a82957a tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:22.928247 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6ec977b5-60e4-40c1-8135-23546a82957a tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:23.010603 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-6ec977b5-60e4-40c1-8135-23546a82957a tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de4ab63f6447eabefe34f65c71d918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879e3eacb3bc4b69891677c86bbd5de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:17:23.018866 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-6ec977b5-60e4-40c1-8135-23546a82957a tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81" status: 200 len: 1612 microversion: 2.1 time: 0.123804 Jun 08 02:17:23.019444 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 497/979] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:17:22 2022] GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81 => generated 1612 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:17:23.132893 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3da4b950-aaa0-4118-a649-2deca11dd3fc tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:23.133508 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3da4b950-aaa0-4118-a649-2deca11dd3fc tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:23.140304 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3da4b950-aaa0-4118-a649-2deca11dd3fc tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:23.141206 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3da4b950-aaa0-4118-a649-2deca11dd3fc tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:23.141558 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3da4b950-aaa0-4118-a649-2deca11dd3fc tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:23.141999 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3da4b950-aaa0-4118-a649-2deca11dd3fc tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:23.240319 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-f2cc0734-6e42-4866-acb9-cfe997e3c724 req-ad4946e0-6698-4669-a9db-6f760efa7d6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e4df138-a844-4517-b90d-e9834f10ba81", "name": "network-vif-deleted", "tag": "cc2bb239-d2d8-428f-b312-59fce54f851d"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:17:23.255064 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-f2cc0734-6e42-4866-acb9-cfe997e3c724 req-ad4946e0-6698-4669-a9db-6f760efa7d6e service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:23.255690 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-f2cc0734-6e42-4866-acb9-cfe997e3c724 req-ad4946e0-6698-4669-a9db-6f760efa7d6e service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:23.269842 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-f2cc0734-6e42-4866-acb9-cfe997e3c724 req-ad4946e0-6698-4669-a9db-6f760efa7d6e service nova] Creating event network-vif-deleted:cc2bb239-d2d8-428f-b312-59fce54f851d for instance 6e4df138-a844-4517-b90d-e9834f10ba81 on hv-cinder-84506 Jun 08 02:17:23.275706 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-f2cc0734-6e42-4866-acb9-cfe997e3c724 req-ad4946e0-6698-4669-a9db-6f760efa7d6e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049583 Jun 08 02:17:23.276992 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 498/980] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:17:23.318897 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3da4b950-aaa0-4118-a649-2deca11dd3fc tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:17:23.329732 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3da4b950-aaa0-4118-a649-2deca11dd3fc tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de" status: 200 len: 1265 microversion: 2.1 time: 0.200580 Jun 08 02:17:23.337306 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 483/981] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:17:23 2022] GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:17:24.036471 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-396aa29c-7e77-401b-b4ec-2a564b7bdf27 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:24.037170 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-396aa29c-7e77-401b-b4ec-2a564b7bdf27 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 6e4df138-a844-4517-b90d-e9834f10ba81] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:24.045142 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-396aa29c-7e77-401b-b4ec-2a564b7bdf27 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:24.045583 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-396aa29c-7e77-401b-b4ec-2a564b7bdf27 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:24.046347 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-396aa29c-7e77-401b-b4ec-2a564b7bdf27 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:24.046776 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-396aa29c-7e77-401b-b4ec-2a564b7bdf27 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:24.063351 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-396aa29c-7e77-401b-b4ec-2a564b7bdf27 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] HTTP exception thrown: Instance 6e4df138-a844-4517-b90d-e9834f10ba81 could not be found. Jun 08 02:17:24.064328 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-396aa29c-7e77-401b-b4ec-2a564b7bdf27 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Request method failure captured: Jun 08 02:17:24.064328 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81 HTTP/1.1 Jun 08 02:17:24.064328 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept: application/json Jun 08 02:17:24.064328 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jun 08 02:17:24.064328 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Connection: close Jun 08 02:17:24.064328 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jun 08 02:17:24.064328 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jun 08 02:17:24.064328 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Host: 10.222.0.20 Jun 08 02:17:24.064328 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jun 08 02:17:24.064328 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jun 08 02:17:24.064328 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABioAW4IUxpz8uFDDL-2EiTBkCBex8I37pHedcb3KtOxR_5Qkw-FZcb_F__ZONQItVnmknDOkkzAj6A6u4qKVTec739oTRvutk80ABlxe7TWtEaCPh_VPhrokhrvddPC6ZdyKbKBz4FSnU6iiSRK8RTfn44nLulYip7apELdvL-QYgXa4o Jun 08 02:17:24.064328 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jun 08 02:17:24.064328 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jun 08 02:17:24.064328 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jun 08 02:17:24.064328 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jun 08 02:17:24.064328 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jun 08 02:17:24.064328 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jun 08 02:17:24.064328 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Id: 879e3eacb3bc4b69891677c86bbd5de3 Jun 08 02:17:24.064328 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:17:24.064328 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jun 08 02:17:24.064328 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jun 08 02:17:24.065825 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/879e3eacb3bc4b69891677c86bbd5de3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_879e3eacb3bc4b69891677c86bbd5de3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/879e3eacb3bc4b69891677c86bbd5de3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/879e3eacb3bc4b69891677c86bbd5de3"}]}] Jun 08 02:17:24.065825 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:17:24.065825 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 879e3eacb3bc4b69891677c86bbd5de3 Jun 08 02:17:24.065825 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:17:24.065825 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User: tempest-AttachVolumeNegativeTest-695083649-project Jun 08 02:17:24.065825 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jun 08 02:17:24.065825 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jun 08 02:17:24.065825 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Id: 92de4ab63f6447eabefe34f65c71d918 Jun 08 02:17:24.065825 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-AttachVolumeNegativeTest-695083649-project Jun 08 02:17:24.065825 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: method: > Jun 08 02:17:24.065825 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: exception: Instance 6e4df138-a844-4517-b90d-e9834f10ba81 could not be found. Jun 08 02:17:24.065825 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: action_args: {'id': '6e4df138-a844-4517-b90d-e9834f10ba81'} Jun 08 02:17:24.067784 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:17:24.067784 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:17:24.067784 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:17:24.067784 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:17:24.067784 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:17:24.067784 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:17:24.067784 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:17:24.067784 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:17:24.067784 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:17:24.067784 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:17:24.067784 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e4df138-a844-4517-b90d-e9834f10ba81 could not be found. Jun 08 02:17:24.067784 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:17:24.067784 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:17:24.067784 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:17:24.067784 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:17:24.067784 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:17:24.067784 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:17:24.067784 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:17:24.067784 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:17:24.067784 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:17:24.069153 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:17:24.069153 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 02:17:24.069153 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 02:17:24.069153 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:17:24.069153 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:17:24.069153 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:17:24.069153 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:17:24.069153 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e4df138-a844-4517-b90d-e9834f10ba81 could not be found. Jun 08 02:17:24.069153 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:17:24.069153 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:17:24.069153 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:17:24.069153 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:17:24.069153 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:17:24.069153 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:17:24.069153 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:17:24.069153 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:17:24.069153 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e4df138-a844-4517-b90d-e9834f10ba81 could not be found. Jun 08 02:17:24.069153 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:17:24.070344 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-396aa29c-7e77-401b-b4ec-2a564b7bdf27 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Returning 404 to user: Instance 6e4df138-a844-4517-b90d-e9834f10ba81 could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:17:24.070344 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-396aa29c-7e77-401b-b4ec-2a564b7bdf27 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81" status: 404 len: 111 microversion: 2.1 time: 0.033562 Jun 08 02:17:24.070344 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 499/982] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:17:24 2022] GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 02:17:24.077236 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-59785157-73f7-4035-8ebb-67f0c4e08dc0 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '.version_select at 0x7f83700d0ca0>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:24.098382 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-59785157-73f7-4035-8ebb-67f0c4e08dc0 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-145314380" status: 202 len: 0 microversion: 2.1 time: 0.026364 Jun 08 02:17:24.103343 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 484/983] 10.222.0.20 () {58 vars in 1217 bytes} [Wed Jun 8 02:17:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-145314380 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 02:17:24.347459 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-203998ae-20d5-4d5a-a5fc-943f52e911db tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:24.348621 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-203998ae-20d5-4d5a-a5fc-943f52e911db tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:24.360434 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-203998ae-20d5-4d5a-a5fc-943f52e911db tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:24.361082 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-203998ae-20d5-4d5a-a5fc-943f52e911db tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:24.361867 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-203998ae-20d5-4d5a-a5fc-943f52e911db tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:24.362314 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-203998ae-20d5-4d5a-a5fc-943f52e911db tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:24.574330 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-203998ae-20d5-4d5a-a5fc-943f52e911db tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:17:24.582551 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-203998ae-20d5-4d5a-a5fc-943f52e911db tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de" status: 200 len: 1265 microversion: 2.1 time: 0.239298 Jun 08 02:17:24.583287 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 500/984] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:17:24 2022] GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de => generated 1265 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:17:25.596878 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:17:25.597623 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=6 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:17:25.601476 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f8235fe4-ffdd-4fa1-9e8d-6740aec2ae41 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:25.602072 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f8235fe4-ffdd-4fa1-9e8d-6740aec2ae41 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:25.609161 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f8235fe4-ffdd-4fa1-9e8d-6740aec2ae41 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:25.609629 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f8235fe4-ffdd-4fa1-9e8d-6740aec2ae41 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:25.610385 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f8235fe4-ffdd-4fa1-9e8d-6740aec2ae41 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:25.610817 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f8235fe4-ffdd-4fa1-9e8d-6740aec2ae41 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:25.740063 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f8235fe4-ffdd-4fa1-9e8d-6740aec2ae41 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:17:25.748066 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f8235fe4-ffdd-4fa1-9e8d-6740aec2ae41 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de" status: 200 len: 1265 microversion: 2.1 time: 0.152492 Jun 08 02:17:25.748661 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 485/985] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:17:25 2022] GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:17:25.932012 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0d4c55c7-8c5b-4b16-b138-405efbefc73b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:25.933136 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-0d4c55c7-8c5b-4b16-b138-405efbefc73b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 6e4df138-a844-4517-b90d-e9834f10ba81] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:25.935060 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=2 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:17:25.941716 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0d4c55c7-8c5b-4b16-b138-405efbefc73b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:25.942167 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0d4c55c7-8c5b-4b16-b138-405efbefc73b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:25.942976 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0d4c55c7-8c5b-4b16-b138-405efbefc73b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:25.943445 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0d4c55c7-8c5b-4b16-b138-405efbefc73b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:25.957717 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-0d4c55c7-8c5b-4b16-b138-405efbefc73b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] HTTP exception thrown: Instance 6e4df138-a844-4517-b90d-e9834f10ba81 could not be found. Jun 08 02:17:25.959270 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0d4c55c7-8c5b-4b16-b138-405efbefc73b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Request method failure captured: Jun 08 02:17:25.959270 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: request: DELETE /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81 HTTP/1.1 Jun 08 02:17:25.959270 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept: application/json Jun 08 02:17:25.959270 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jun 08 02:17:25.959270 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Connection: close Jun 08 02:17:25.959270 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jun 08 02:17:25.959270 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jun 08 02:17:25.959270 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Host: 10.222.0.20 Jun 08 02:17:25.959270 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jun 08 02:17:25.959270 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jun 08 02:17:25.959270 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABioAW4IUxpz8uFDDL-2EiTBkCBex8I37pHedcb3KtOxR_5Qkw-FZcb_F__ZONQItVnmknDOkkzAj6A6u4qKVTec739oTRvutk80ABlxe7TWtEaCPh_VPhrokhrvddPC6ZdyKbKBz4FSnU6iiSRK8RTfn44nLulYip7apELdvL-QYgXa4o Jun 08 02:17:25.959270 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jun 08 02:17:25.959270 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jun 08 02:17:25.959270 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jun 08 02:17:25.959270 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jun 08 02:17:25.959270 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jun 08 02:17:25.959270 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jun 08 02:17:25.959270 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Id: 879e3eacb3bc4b69891677c86bbd5de3 Jun 08 02:17:25.959270 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:17:25.959270 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jun 08 02:17:25.959270 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jun 08 02:17:25.961064 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/879e3eacb3bc4b69891677c86bbd5de3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_879e3eacb3bc4b69891677c86bbd5de3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/879e3eacb3bc4b69891677c86bbd5de3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/879e3eacb3bc4b69891677c86bbd5de3"}]}] Jun 08 02:17:25.961064 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:17:25.961064 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 879e3eacb3bc4b69891677c86bbd5de3 Jun 08 02:17:25.961064 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:17:25.961064 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User: tempest-AttachVolumeNegativeTest-695083649-project Jun 08 02:17:25.961064 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jun 08 02:17:25.961064 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jun 08 02:17:25.961064 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Id: 92de4ab63f6447eabefe34f65c71d918 Jun 08 02:17:25.961064 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-AttachVolumeNegativeTest-695083649-project Jun 08 02:17:25.961064 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: method: > Jun 08 02:17:25.961064 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: exception: Instance 6e4df138-a844-4517-b90d-e9834f10ba81 could not be found. Jun 08 02:17:25.961064 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: action_args: {'id': '6e4df138-a844-4517-b90d-e9834f10ba81'} Jun 08 02:17:25.961953 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:17:25.961953 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:17:25.961953 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:17:25.961953 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:17:25.961953 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:17:25.961953 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:17:25.961953 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:17:25.961953 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:17:25.961953 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:17:25.961953 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:17:25.961953 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e4df138-a844-4517-b90d-e9834f10ba81 could not be found. Jun 08 02:17:25.961953 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:17:25.961953 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:17:25.961953 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:17:25.961953 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:17:25.961953 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:17:25.961953 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:17:25.961953 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:17:25.961953 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:17:25.961953 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:17:25.963394 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:17:25.963394 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 08 02:17:25.963394 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 08 02:17:25.963394 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 08 02:17:25.963394 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 08 02:17:25.963394 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:17:25.963394 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:17:25.963394 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:17:25.963394 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:17:25.963394 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e4df138-a844-4517-b90d-e9834f10ba81 could not be found. Jun 08 02:17:25.963394 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:17:25.963394 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:17:25.963394 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:17:25.963394 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:17:25.963394 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:17:25.963394 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:17:25.963394 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:17:25.963394 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:17:25.963394 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e4df138-a844-4517-b90d-e9834f10ba81 could not be found. Jun 08 02:17:25.963394 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:17:25.965242 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0d4c55c7-8c5b-4b16-b138-405efbefc73b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Returning 404 to user: Instance 6e4df138-a844-4517-b90d-e9834f10ba81 could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:17:25.965242 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-0d4c55c7-8c5b-4b16-b138-405efbefc73b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81" status: 404 len: 111 microversion: 2.1 time: 0.032521 Jun 08 02:17:25.965242 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 501/986] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jun 8 02:17:25 2022] DELETE /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 02:17:25.969305 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e07d080e-6617-409e-abd3-8ea4da89589b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:25.969916 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e07d080e-6617-409e-abd3-8ea4da89589b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 6e4df138-a844-4517-b90d-e9834f10ba81] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:25.975852 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e07d080e-6617-409e-abd3-8ea4da89589b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:25.976299 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e07d080e-6617-409e-abd3-8ea4da89589b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:25.977095 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e07d080e-6617-409e-abd3-8ea4da89589b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:25.977529 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e07d080e-6617-409e-abd3-8ea4da89589b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:25.990560 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-e07d080e-6617-409e-abd3-8ea4da89589b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] HTTP exception thrown: Instance 6e4df138-a844-4517-b90d-e9834f10ba81 could not be found. Jun 08 02:17:25.992162 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e07d080e-6617-409e-abd3-8ea4da89589b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Request method failure captured: Jun 08 02:17:25.992162 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81 HTTP/1.1 Jun 08 02:17:25.992162 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept: application/json Jun 08 02:17:25.992162 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jun 08 02:17:25.992162 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Connection: close Jun 08 02:17:25.992162 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jun 08 02:17:25.992162 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jun 08 02:17:25.992162 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Host: 10.222.0.20 Jun 08 02:17:25.992162 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jun 08 02:17:25.992162 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jun 08 02:17:25.992162 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABioAW4IUxpz8uFDDL-2EiTBkCBex8I37pHedcb3KtOxR_5Qkw-FZcb_F__ZONQItVnmknDOkkzAj6A6u4qKVTec739oTRvutk80ABlxe7TWtEaCPh_VPhrokhrvddPC6ZdyKbKBz4FSnU6iiSRK8RTfn44nLulYip7apELdvL-QYgXa4o Jun 08 02:17:25.992162 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jun 08 02:17:25.992162 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jun 08 02:17:25.992162 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jun 08 02:17:25.992162 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jun 08 02:17:25.992162 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jun 08 02:17:25.992162 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jun 08 02:17:25.992162 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Id: 879e3eacb3bc4b69891677c86bbd5de3 Jun 08 02:17:25.992162 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:17:25.992162 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jun 08 02:17:25.992162 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jun 08 02:17:25.993758 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/879e3eacb3bc4b69891677c86bbd5de3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_879e3eacb3bc4b69891677c86bbd5de3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/879e3eacb3bc4b69891677c86bbd5de3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/879e3eacb3bc4b69891677c86bbd5de3"}]}] Jun 08 02:17:25.993758 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:17:25.993758 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 879e3eacb3bc4b69891677c86bbd5de3 Jun 08 02:17:25.993758 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:17:25.993758 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeNegativeTest-695083649-project Jun 08 02:17:25.993758 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jun 08 02:17:25.993758 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jun 08 02:17:25.993758 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Id: 92de4ab63f6447eabefe34f65c71d918 Jun 08 02:17:25.993758 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeNegativeTest-695083649-project Jun 08 02:17:25.993758 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: method: > Jun 08 02:17:25.993758 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: exception: Instance 6e4df138-a844-4517-b90d-e9834f10ba81 could not be found. Jun 08 02:17:25.993758 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: action_args: {'id': '6e4df138-a844-4517-b90d-e9834f10ba81'} Jun 08 02:17:25.994639 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:17:25.994639 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:17:25.994639 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:17:25.994639 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:17:25.994639 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:17:25.994639 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:17:25.994639 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:17:25.994639 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:17:25.994639 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:17:25.994639 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:17:25.994639 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e4df138-a844-4517-b90d-e9834f10ba81 could not be found. Jun 08 02:17:25.994639 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:17:25.994639 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:17:25.994639 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:17:25.994639 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:17:25.994639 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:17:25.994639 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:17:25.994639 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:17:25.994639 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:17:25.994639 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:17:25.996913 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:17:25.996913 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 02:17:25.996913 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 02:17:25.996913 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:17:25.996913 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:17:25.996913 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:17:25.996913 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:17:25.996913 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e4df138-a844-4517-b90d-e9834f10ba81 could not be found. Jun 08 02:17:25.996913 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:17:25.996913 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:17:25.996913 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:17:25.996913 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:17:25.996913 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:17:25.996913 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:17:25.996913 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:17:25.996913 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:17:25.996913 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e4df138-a844-4517-b90d-e9834f10ba81 could not be found. Jun 08 02:17:25.996913 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:17:25.998610 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e07d080e-6617-409e-abd3-8ea4da89589b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Returning 404 to user: Instance 6e4df138-a844-4517-b90d-e9834f10ba81 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:17:25.998610 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e07d080e-6617-409e-abd3-8ea4da89589b tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81" status: 404 len: 111 microversion: 2.1 time: 0.028159 Jun 08 02:17:25.998610 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 486/987] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:17:25 2022] GET /compute/v2.1/servers/6e4df138-a844-4517-b90d-e9834f10ba81 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 02:17:26.764118 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-36bcfde9-6f32-4740-a98c-8156532e78bc tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:26.764743 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-36bcfde9-6f32-4740-a98c-8156532e78bc tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:26.770674 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-36bcfde9-6f32-4740-a98c-8156532e78bc tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:26.771116 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-36bcfde9-6f32-4740-a98c-8156532e78bc tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:26.771859 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-36bcfde9-6f32-4740-a98c-8156532e78bc tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:26.772287 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-36bcfde9-6f32-4740-a98c-8156532e78bc tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:26.899171 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-36bcfde9-6f32-4740-a98c-8156532e78bc tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:17:26.907249 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-36bcfde9-6f32-4740-a98c-8156532e78bc tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de" status: 200 len: 1265 microversion: 2.1 time: 0.146933 Jun 08 02:17:26.907794 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 502/988] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:17:26 2022] GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:17:27.125305 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-38e81bfd-e0ed-4423-8b07-bba2c29601c6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:27.125791 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-38e81bfd-e0ed-4423-8b07-bba2c29601c6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 9c868872-2f72-4087-a4c5-ce9521b788b8] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:27.132139 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-38e81bfd-e0ed-4423-8b07-bba2c29601c6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:27.132627 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-38e81bfd-e0ed-4423-8b07-bba2c29601c6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:27.133399 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-38e81bfd-e0ed-4423-8b07-bba2c29601c6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:27.133835 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-38e81bfd-e0ed-4423-8b07-bba2c29601c6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:27.147826 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-38e81bfd-e0ed-4423-8b07-bba2c29601c6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] HTTP exception thrown: Instance 9c868872-2f72-4087-a4c5-ce9521b788b8 could not be found. Jun 08 02:17:27.149393 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-38e81bfd-e0ed-4423-8b07-bba2c29601c6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Request method failure captured: Jun 08 02:17:27.149393 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: request: DELETE /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8 HTTP/1.1 Jun 08 02:17:27.149393 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept: application/json Jun 08 02:17:27.149393 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jun 08 02:17:27.149393 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Connection: close Jun 08 02:17:27.149393 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jun 08 02:17:27.149393 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jun 08 02:17:27.149393 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Host: 10.222.0.20 Jun 08 02:17:27.149393 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jun 08 02:17:27.149393 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jun 08 02:17:27.149393 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABioAW4IUxpz8uFDDL-2EiTBkCBex8I37pHedcb3KtOxR_5Qkw-FZcb_F__ZONQItVnmknDOkkzAj6A6u4qKVTec739oTRvutk80ABlxe7TWtEaCPh_VPhrokhrvddPC6ZdyKbKBz4FSnU6iiSRK8RTfn44nLulYip7apELdvL-QYgXa4o Jun 08 02:17:27.149393 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jun 08 02:17:27.149393 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jun 08 02:17:27.149393 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jun 08 02:17:27.149393 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jun 08 02:17:27.149393 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jun 08 02:17:27.149393 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jun 08 02:17:27.149393 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Id: 879e3eacb3bc4b69891677c86bbd5de3 Jun 08 02:17:27.149393 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:17:27.149393 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jun 08 02:17:27.149393 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jun 08 02:17:27.150919 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/879e3eacb3bc4b69891677c86bbd5de3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_879e3eacb3bc4b69891677c86bbd5de3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/879e3eacb3bc4b69891677c86bbd5de3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/879e3eacb3bc4b69891677c86bbd5de3"}]}] Jun 08 02:17:27.150919 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:17:27.150919 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 879e3eacb3bc4b69891677c86bbd5de3 Jun 08 02:17:27.150919 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:17:27.150919 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeNegativeTest-695083649-project Jun 08 02:17:27.150919 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jun 08 02:17:27.150919 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jun 08 02:17:27.150919 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Id: 92de4ab63f6447eabefe34f65c71d918 Jun 08 02:17:27.150919 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeNegativeTest-695083649-project Jun 08 02:17:27.150919 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: method: > Jun 08 02:17:27.150919 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: exception: Instance 9c868872-2f72-4087-a4c5-ce9521b788b8 could not be found. Jun 08 02:17:27.150919 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: action_args: {'id': '9c868872-2f72-4087-a4c5-ce9521b788b8'} Jun 08 02:17:27.152332 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:17:27.152332 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:17:27.152332 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:17:27.152332 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:17:27.152332 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:17:27.152332 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:17:27.152332 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:17:27.152332 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:17:27.152332 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:17:27.152332 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:17:27.152332 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c868872-2f72-4087-a4c5-ce9521b788b8 could not be found. Jun 08 02:17:27.152332 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:17:27.152332 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:17:27.152332 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:17:27.152332 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:17:27.152332 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:17:27.152332 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:17:27.152332 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:17:27.152332 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:17:27.152332 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:17:27.154294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:17:27.154294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 08 02:17:27.154294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 08 02:17:27.154294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 08 02:17:27.154294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 08 02:17:27.154294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:17:27.154294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:17:27.154294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:17:27.154294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:17:27.154294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c868872-2f72-4087-a4c5-ce9521b788b8 could not be found. Jun 08 02:17:27.154294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:17:27.154294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:17:27.154294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:17:27.154294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:17:27.154294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:17:27.154294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:17:27.154294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:17:27.154294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:17:27.154294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c868872-2f72-4087-a4c5-ce9521b788b8 could not be found. Jun 08 02:17:27.154294 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:17:27.155934 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-38e81bfd-e0ed-4423-8b07-bba2c29601c6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Returning 404 to user: Instance 9c868872-2f72-4087-a4c5-ce9521b788b8 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:17:27.155934 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-38e81bfd-e0ed-4423-8b07-bba2c29601c6 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8" status: 404 len: 111 microversion: 2.1 time: 0.030005 Jun 08 02:17:27.155934 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 487/989] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jun 8 02:17:27 2022] DELETE /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 08 02:17:27.159979 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c47f4749-f52f-4771-9073-88c959ca2bb2 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:27.160655 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c47f4749-f52f-4771-9073-88c959ca2bb2 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 9c868872-2f72-4087-a4c5-ce9521b788b8] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:27.167300 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c47f4749-f52f-4771-9073-88c959ca2bb2 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:27.167747 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c47f4749-f52f-4771-9073-88c959ca2bb2 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:27.168551 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c47f4749-f52f-4771-9073-88c959ca2bb2 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:27.168990 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c47f4749-f52f-4771-9073-88c959ca2bb2 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:27.182021 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-c47f4749-f52f-4771-9073-88c959ca2bb2 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] HTTP exception thrown: Instance 9c868872-2f72-4087-a4c5-ce9521b788b8 could not be found. Jun 08 02:17:27.184209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c47f4749-f52f-4771-9073-88c959ca2bb2 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Request method failure captured: Jun 08 02:17:27.184209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8 HTTP/1.1 Jun 08 02:17:27.184209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept: application/json Jun 08 02:17:27.184209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jun 08 02:17:27.184209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Connection: close Jun 08 02:17:27.184209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jun 08 02:17:27.184209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jun 08 02:17:27.184209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Host: 10.222.0.20 Jun 08 02:17:27.184209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jun 08 02:17:27.184209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jun 08 02:17:27.184209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABioAW4IUxpz8uFDDL-2EiTBkCBex8I37pHedcb3KtOxR_5Qkw-FZcb_F__ZONQItVnmknDOkkzAj6A6u4qKVTec739oTRvutk80ABlxe7TWtEaCPh_VPhrokhrvddPC6ZdyKbKBz4FSnU6iiSRK8RTfn44nLulYip7apELdvL-QYgXa4o Jun 08 02:17:27.184209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jun 08 02:17:27.184209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jun 08 02:17:27.184209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jun 08 02:17:27.184209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jun 08 02:17:27.184209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jun 08 02:17:27.184209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jun 08 02:17:27.184209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Id: 879e3eacb3bc4b69891677c86bbd5de3 Jun 08 02:17:27.184209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:17:27.184209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jun 08 02:17:27.184209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jun 08 02:17:27.185928 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/879e3eacb3bc4b69891677c86bbd5de3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_879e3eacb3bc4b69891677c86bbd5de3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/879e3eacb3bc4b69891677c86bbd5de3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/879e3eacb3bc4b69891677c86bbd5de3"}]}] Jun 08 02:17:27.185928 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:17:27.185928 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 879e3eacb3bc4b69891677c86bbd5de3 Jun 08 02:17:27.185928 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:17:27.185928 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User: tempest-AttachVolumeNegativeTest-695083649-project Jun 08 02:17:27.185928 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jun 08 02:17:27.185928 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jun 08 02:17:27.185928 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Id: 92de4ab63f6447eabefe34f65c71d918 Jun 08 02:17:27.185928 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-AttachVolumeNegativeTest-695083649-project Jun 08 02:17:27.185928 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: method: > Jun 08 02:17:27.185928 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: exception: Instance 9c868872-2f72-4087-a4c5-ce9521b788b8 could not be found. Jun 08 02:17:27.185928 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: action_args: {'id': '9c868872-2f72-4087-a4c5-ce9521b788b8'} Jun 08 02:17:27.187364 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:17:27.187364 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:17:27.187364 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:17:27.187364 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:17:27.187364 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:17:27.187364 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:17:27.187364 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:17:27.187364 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:17:27.187364 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:17:27.187364 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:17:27.187364 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c868872-2f72-4087-a4c5-ce9521b788b8 could not be found. Jun 08 02:17:27.187364 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:17:27.187364 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:17:27.187364 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:17:27.187364 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:17:27.187364 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:17:27.187364 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:17:27.187364 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:17:27.187364 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:17:27.187364 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:17:27.188863 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:17:27.188863 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 02:17:27.188863 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 02:17:27.188863 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:17:27.188863 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:17:27.188863 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:17:27.188863 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:17:27.188863 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c868872-2f72-4087-a4c5-ce9521b788b8 could not be found. Jun 08 02:17:27.188863 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:17:27.188863 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:17:27.188863 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:17:27.188863 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:17:27.188863 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:17:27.188863 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:17:27.188863 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:17:27.188863 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:17:27.188863 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c868872-2f72-4087-a4c5-ce9521b788b8 could not be found. Jun 08 02:17:27.188863 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:17:27.190188 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c47f4749-f52f-4771-9073-88c959ca2bb2 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Returning 404 to user: Instance 9c868872-2f72-4087-a4c5-ce9521b788b8 could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:17:27.190188 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c47f4749-f52f-4771-9073-88c959ca2bb2 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8" status: 404 len: 111 microversion: 2.1 time: 0.029467 Jun 08 02:17:27.190188 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 503/990] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:17:27 2022] GET /compute/v2.1/servers/9c868872-2f72-4087-a4c5-ce9521b788b8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 02:17:27.195518 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4464136f-35da-4027-b1e9-8b83277a88c0 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:27.196017 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4464136f-35da-4027-b1e9-8b83277a88c0 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 8870cf32-82de-4bee-98fd-08b49f529cf3] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:27.202789 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4464136f-35da-4027-b1e9-8b83277a88c0 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:27.203231 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4464136f-35da-4027-b1e9-8b83277a88c0 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:27.204145 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4464136f-35da-4027-b1e9-8b83277a88c0 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:27.204612 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4464136f-35da-4027-b1e9-8b83277a88c0 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:27.208695 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:17:27.219489 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-4464136f-35da-4027-b1e9-8b83277a88c0 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] HTTP exception thrown: Instance 8870cf32-82de-4bee-98fd-08b49f529cf3 could not be found. Jun 08 02:17:27.221286 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4464136f-35da-4027-b1e9-8b83277a88c0 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Request method failure captured: Jun 08 02:17:27.221286 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: request: DELETE /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3 HTTP/1.1 Jun 08 02:17:27.221286 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept: application/json Jun 08 02:17:27.221286 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jun 08 02:17:27.221286 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Connection: close Jun 08 02:17:27.221286 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jun 08 02:17:27.221286 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jun 08 02:17:27.221286 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Host: 10.222.0.20 Jun 08 02:17:27.221286 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jun 08 02:17:27.221286 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jun 08 02:17:27.221286 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABioAW4IUxpz8uFDDL-2EiTBkCBex8I37pHedcb3KtOxR_5Qkw-FZcb_F__ZONQItVnmknDOkkzAj6A6u4qKVTec739oTRvutk80ABlxe7TWtEaCPh_VPhrokhrvddPC6ZdyKbKBz4FSnU6iiSRK8RTfn44nLulYip7apELdvL-QYgXa4o Jun 08 02:17:27.221286 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jun 08 02:17:27.221286 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jun 08 02:17:27.221286 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jun 08 02:17:27.221286 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jun 08 02:17:27.221286 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jun 08 02:17:27.221286 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jun 08 02:17:27.221286 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Id: 879e3eacb3bc4b69891677c86bbd5de3 Jun 08 02:17:27.221286 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:17:27.221286 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jun 08 02:17:27.221286 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jun 08 02:17:27.222887 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/879e3eacb3bc4b69891677c86bbd5de3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_879e3eacb3bc4b69891677c86bbd5de3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/879e3eacb3bc4b69891677c86bbd5de3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/879e3eacb3bc4b69891677c86bbd5de3"}]}] Jun 08 02:17:27.222887 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:17:27.222887 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 879e3eacb3bc4b69891677c86bbd5de3 Jun 08 02:17:27.222887 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:17:27.222887 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeNegativeTest-695083649-project Jun 08 02:17:27.222887 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jun 08 02:17:27.222887 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jun 08 02:17:27.222887 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Id: 92de4ab63f6447eabefe34f65c71d918 Jun 08 02:17:27.222887 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeNegativeTest-695083649-project Jun 08 02:17:27.222887 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: method: > Jun 08 02:17:27.222887 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: exception: Instance 8870cf32-82de-4bee-98fd-08b49f529cf3 could not be found. Jun 08 02:17:27.222887 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: action_args: {'id': '8870cf32-82de-4bee-98fd-08b49f529cf3'} Jun 08 02:17:27.223724 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:17:27.223724 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:17:27.223724 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:17:27.223724 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:17:27.223724 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:17:27.223724 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:17:27.223724 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:17:27.223724 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:17:27.223724 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:17:27.223724 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:17:27.223724 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8870cf32-82de-4bee-98fd-08b49f529cf3 could not be found. Jun 08 02:17:27.223724 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:17:27.223724 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:17:27.223724 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:17:27.223724 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:17:27.223724 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:17:27.223724 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:17:27.223724 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:17:27.223724 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:17:27.223724 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:17:27.225167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:17:27.225167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 08 02:17:27.225167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 08 02:17:27.225167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 08 02:17:27.225167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 08 02:17:27.225167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:17:27.225167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:17:27.225167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:17:27.225167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:17:27.225167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8870cf32-82de-4bee-98fd-08b49f529cf3 could not be found. Jun 08 02:17:27.225167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:17:27.225167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:17:27.225167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:17:27.225167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:17:27.225167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:17:27.225167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:17:27.225167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:17:27.225167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:17:27.225167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8870cf32-82de-4bee-98fd-08b49f529cf3 could not be found. Jun 08 02:17:27.225167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:17:27.226723 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4464136f-35da-4027-b1e9-8b83277a88c0 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Returning 404 to user: Instance 8870cf32-82de-4bee-98fd-08b49f529cf3 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:17:27.226723 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4464136f-35da-4027-b1e9-8b83277a88c0 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3" status: 404 len: 111 microversion: 2.1 time: 0.032050 Jun 08 02:17:27.226723 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 488/991] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jun 8 02:17:27 2022] DELETE /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 02:17:27.231552 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-14e1e5cb-e60a-4591-857c-8b16833be7e0 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:27.232613 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-14e1e5cb-e60a-4591-857c-8b16833be7e0 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 8870cf32-82de-4bee-98fd-08b49f529cf3] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:27.238892 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-14e1e5cb-e60a-4591-857c-8b16833be7e0 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:27.239331 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-14e1e5cb-e60a-4591-857c-8b16833be7e0 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:27.240083 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-14e1e5cb-e60a-4591-857c-8b16833be7e0 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:27.240550 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-14e1e5cb-e60a-4591-857c-8b16833be7e0 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:27.253875 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-14e1e5cb-e60a-4591-857c-8b16833be7e0 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] HTTP exception thrown: Instance 8870cf32-82de-4bee-98fd-08b49f529cf3 could not be found. Jun 08 02:17:27.255375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-14e1e5cb-e60a-4591-857c-8b16833be7e0 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Request method failure captured: Jun 08 02:17:27.255375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3 HTTP/1.1 Jun 08 02:17:27.255375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept: application/json Jun 08 02:17:27.255375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jun 08 02:17:27.255375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Connection: close Jun 08 02:17:27.255375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jun 08 02:17:27.255375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jun 08 02:17:27.255375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Host: 10.222.0.20 Jun 08 02:17:27.255375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jun 08 02:17:27.255375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jun 08 02:17:27.255375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABioAW4IUxpz8uFDDL-2EiTBkCBex8I37pHedcb3KtOxR_5Qkw-FZcb_F__ZONQItVnmknDOkkzAj6A6u4qKVTec739oTRvutk80ABlxe7TWtEaCPh_VPhrokhrvddPC6ZdyKbKBz4FSnU6iiSRK8RTfn44nLulYip7apELdvL-QYgXa4o Jun 08 02:17:27.255375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jun 08 02:17:27.255375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jun 08 02:17:27.255375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jun 08 02:17:27.255375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jun 08 02:17:27.255375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jun 08 02:17:27.255375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jun 08 02:17:27.255375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Id: 879e3eacb3bc4b69891677c86bbd5de3 Jun 08 02:17:27.255375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:17:27.255375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jun 08 02:17:27.255375 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jun 08 02:17:27.257026 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/879e3eacb3bc4b69891677c86bbd5de3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_879e3eacb3bc4b69891677c86bbd5de3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/879e3eacb3bc4b69891677c86bbd5de3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/879e3eacb3bc4b69891677c86bbd5de3"}]}] Jun 08 02:17:27.257026 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:17:27.257026 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 879e3eacb3bc4b69891677c86bbd5de3 Jun 08 02:17:27.257026 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:17:27.257026 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User: tempest-AttachVolumeNegativeTest-695083649-project Jun 08 02:17:27.257026 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jun 08 02:17:27.257026 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jun 08 02:17:27.257026 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Id: 92de4ab63f6447eabefe34f65c71d918 Jun 08 02:17:27.257026 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-AttachVolumeNegativeTest-695083649-project Jun 08 02:17:27.257026 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: method: > Jun 08 02:17:27.257026 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: exception: Instance 8870cf32-82de-4bee-98fd-08b49f529cf3 could not be found. Jun 08 02:17:27.257026 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: action_args: {'id': '8870cf32-82de-4bee-98fd-08b49f529cf3'} Jun 08 02:17:27.257878 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:17:27.257878 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:17:27.257878 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:17:27.257878 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:17:27.257878 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:17:27.257878 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:17:27.257878 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:17:27.257878 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:17:27.257878 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:17:27.257878 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:17:27.257878 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8870cf32-82de-4bee-98fd-08b49f529cf3 could not be found. Jun 08 02:17:27.257878 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:17:27.257878 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:17:27.257878 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:17:27.257878 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:17:27.257878 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:17:27.257878 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:17:27.257878 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:17:27.257878 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:17:27.257878 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:17:27.259368 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:17:27.259368 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 02:17:27.259368 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 02:17:27.259368 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:17:27.259368 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:17:27.259368 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:17:27.259368 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:17:27.259368 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8870cf32-82de-4bee-98fd-08b49f529cf3 could not be found. Jun 08 02:17:27.259368 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:17:27.259368 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:17:27.259368 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:17:27.259368 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:17:27.259368 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:17:27.259368 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:17:27.259368 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:17:27.259368 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:17:27.259368 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8870cf32-82de-4bee-98fd-08b49f529cf3 could not be found. Jun 08 02:17:27.259368 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:17:27.261364 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-14e1e5cb-e60a-4591-857c-8b16833be7e0 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Returning 404 to user: Instance 8870cf32-82de-4bee-98fd-08b49f529cf3 could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:17:27.261364 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-14e1e5cb-e60a-4591-857c-8b16833be7e0 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3" status: 404 len: 111 microversion: 2.1 time: 0.029450 Jun 08 02:17:27.261364 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 504/992] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:17:27 2022] GET /compute/v2.1/servers/8870cf32-82de-4bee-98fd-08b49f529cf3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 02:17:27.923622 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3d207dae-79bd-41c3-81f6-f4d49f24617b tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:27.924264 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3d207dae-79bd-41c3-81f6-f4d49f24617b tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:27.931360 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3d207dae-79bd-41c3-81f6-f4d49f24617b tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:27.931807 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3d207dae-79bd-41c3-81f6-f4d49f24617b tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:27.933426 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3d207dae-79bd-41c3-81f6-f4d49f24617b tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:27.933922 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3d207dae-79bd-41c3-81f6-f4d49f24617b tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:28.067668 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3d207dae-79bd-41c3-81f6-f4d49f24617b tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:17:28.075196 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3d207dae-79bd-41c3-81f6-f4d49f24617b tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de" status: 200 len: 1265 microversion: 2.1 time: 0.155441 Jun 08 02:17:28.075761 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 489/993] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:17:27 2022] GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:17:28.391383 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a44e4cc8-2460-43c7-8cdb-fae0f02e8945 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:28.391872 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a44e4cc8-2460-43c7-8cdb-fae0f02e8945 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 78009a5e-d759-4faf-8ef4-fe4d5612a690] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:28.398209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a44e4cc8-2460-43c7-8cdb-fae0f02e8945 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:28.398650 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a44e4cc8-2460-43c7-8cdb-fae0f02e8945 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:28.399407 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a44e4cc8-2460-43c7-8cdb-fae0f02e8945 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:28.399836 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a44e4cc8-2460-43c7-8cdb-fae0f02e8945 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:28.413742 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-a44e4cc8-2460-43c7-8cdb-fae0f02e8945 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] HTTP exception thrown: Instance 78009a5e-d759-4faf-8ef4-fe4d5612a690 could not be found. Jun 08 02:17:28.415241 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a44e4cc8-2460-43c7-8cdb-fae0f02e8945 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Request method failure captured: Jun 08 02:17:28.415241 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: request: DELETE /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690 HTTP/1.1 Jun 08 02:17:28.415241 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept: application/json Jun 08 02:17:28.415241 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jun 08 02:17:28.415241 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Connection: close Jun 08 02:17:28.415241 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jun 08 02:17:28.415241 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jun 08 02:17:28.415241 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Host: 10.222.0.20 Jun 08 02:17:28.415241 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jun 08 02:17:28.415241 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jun 08 02:17:28.415241 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABioAW4IUxpz8uFDDL-2EiTBkCBex8I37pHedcb3KtOxR_5Qkw-FZcb_F__ZONQItVnmknDOkkzAj6A6u4qKVTec739oTRvutk80ABlxe7TWtEaCPh_VPhrokhrvddPC6ZdyKbKBz4FSnU6iiSRK8RTfn44nLulYip7apELdvL-QYgXa4o Jun 08 02:17:28.415241 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jun 08 02:17:28.415241 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jun 08 02:17:28.415241 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jun 08 02:17:28.415241 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jun 08 02:17:28.415241 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jun 08 02:17:28.415241 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jun 08 02:17:28.415241 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Id: 879e3eacb3bc4b69891677c86bbd5de3 Jun 08 02:17:28.415241 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:17:28.415241 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jun 08 02:17:28.415241 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jun 08 02:17:28.416872 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/879e3eacb3bc4b69891677c86bbd5de3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_879e3eacb3bc4b69891677c86bbd5de3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/879e3eacb3bc4b69891677c86bbd5de3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/879e3eacb3bc4b69891677c86bbd5de3"}]}] Jun 08 02:17:28.416872 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:17:28.416872 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 879e3eacb3bc4b69891677c86bbd5de3 Jun 08 02:17:28.416872 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:17:28.416872 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User: tempest-AttachVolumeNegativeTest-695083649-project Jun 08 02:17:28.416872 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jun 08 02:17:28.416872 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jun 08 02:17:28.416872 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Id: 92de4ab63f6447eabefe34f65c71d918 Jun 08 02:17:28.416872 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-AttachVolumeNegativeTest-695083649-project Jun 08 02:17:28.416872 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: method: > Jun 08 02:17:28.416872 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: exception: Instance 78009a5e-d759-4faf-8ef4-fe4d5612a690 could not be found. Jun 08 02:17:28.416872 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: action_args: {'id': '78009a5e-d759-4faf-8ef4-fe4d5612a690'} Jun 08 02:17:28.417655 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:17:28.417655 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:17:28.417655 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:17:28.417655 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:17:28.417655 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:17:28.417655 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:17:28.417655 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:17:28.417655 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:17:28.417655 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:17:28.417655 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:17:28.417655 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78009a5e-d759-4faf-8ef4-fe4d5612a690 could not be found. Jun 08 02:17:28.417655 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:17:28.417655 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:17:28.417655 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:17:28.417655 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:17:28.417655 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:17:28.417655 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:17:28.417655 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:17:28.417655 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:17:28.417655 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:17:28.418874 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:17:28.418874 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 08 02:17:28.418874 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 08 02:17:28.418874 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 08 02:17:28.418874 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 08 02:17:28.418874 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:17:28.418874 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:17:28.418874 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:17:28.418874 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:17:28.418874 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78009a5e-d759-4faf-8ef4-fe4d5612a690 could not be found. Jun 08 02:17:28.418874 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:17:28.418874 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:17:28.418874 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:17:28.418874 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:17:28.418874 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:17:28.418874 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:17:28.418874 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:17:28.418874 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:17:28.418874 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78009a5e-d759-4faf-8ef4-fe4d5612a690 could not be found. Jun 08 02:17:28.418874 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:17:28.420173 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a44e4cc8-2460-43c7-8cdb-fae0f02e8945 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Returning 404 to user: Instance 78009a5e-d759-4faf-8ef4-fe4d5612a690 could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:17:28.420173 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a44e4cc8-2460-43c7-8cdb-fae0f02e8945 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "DELETE /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690" status: 404 len: 111 microversion: 2.1 time: 0.029011 Jun 08 02:17:28.420173 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 505/994] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jun 8 02:17:28 2022] DELETE /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 08 02:17:28.425097 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7d5b004e-6852-4102-ab76-94440c787001 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:28.425750 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7d5b004e-6852-4102-ab76-94440c787001 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] [instance: 78009a5e-d759-4faf-8ef4-fe4d5612a690] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:28.432270 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7d5b004e-6852-4102-ab76-94440c787001 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:28.432753 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7d5b004e-6852-4102-ab76-94440c787001 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:28.433518 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7d5b004e-6852-4102-ab76-94440c787001 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:28.433954 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7d5b004e-6852-4102-ab76-94440c787001 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:28.446934 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-7d5b004e-6852-4102-ab76-94440c787001 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] HTTP exception thrown: Instance 78009a5e-d759-4faf-8ef4-fe4d5612a690 could not be found. Jun 08 02:17:28.448956 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7d5b004e-6852-4102-ab76-94440c787001 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Request method failure captured: Jun 08 02:17:28.448956 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690 HTTP/1.1 Jun 08 02:17:28.448956 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept: application/json Jun 08 02:17:28.448956 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jun 08 02:17:28.448956 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Connection: close Jun 08 02:17:28.448956 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jun 08 02:17:28.448956 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jun 08 02:17:28.448956 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Host: 10.222.0.20 Jun 08 02:17:28.448956 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jun 08 02:17:28.448956 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jun 08 02:17:28.448956 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABioAW4IUxpz8uFDDL-2EiTBkCBex8I37pHedcb3KtOxR_5Qkw-FZcb_F__ZONQItVnmknDOkkzAj6A6u4qKVTec739oTRvutk80ABlxe7TWtEaCPh_VPhrokhrvddPC6ZdyKbKBz4FSnU6iiSRK8RTfn44nLulYip7apELdvL-QYgXa4o Jun 08 02:17:28.448956 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jun 08 02:17:28.448956 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jun 08 02:17:28.448956 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jun 08 02:17:28.448956 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jun 08 02:17:28.448956 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jun 08 02:17:28.448956 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jun 08 02:17:28.448956 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Id: 879e3eacb3bc4b69891677c86bbd5de3 Jun 08 02:17:28.448956 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:17:28.448956 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jun 08 02:17:28.448956 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jun 08 02:17:28.450365 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/879e3eacb3bc4b69891677c86bbd5de3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_879e3eacb3bc4b69891677c86bbd5de3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/879e3eacb3bc4b69891677c86bbd5de3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/879e3eacb3bc4b69891677c86bbd5de3"}]}] Jun 08 02:17:28.450365 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:17:28.450365 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 879e3eacb3bc4b69891677c86bbd5de3 Jun 08 02:17:28.450365 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-695083649 Jun 08 02:17:28.450365 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeNegativeTest-695083649-project Jun 08 02:17:28.450365 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jun 08 02:17:28.450365 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jun 08 02:17:28.450365 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Id: 92de4ab63f6447eabefe34f65c71d918 Jun 08 02:17:28.450365 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeNegativeTest-695083649-project Jun 08 02:17:28.450365 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: method: > Jun 08 02:17:28.450365 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: exception: Instance 78009a5e-d759-4faf-8ef4-fe4d5612a690 could not be found. Jun 08 02:17:28.450365 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: action_args: {'id': '78009a5e-d759-4faf-8ef4-fe4d5612a690'} Jun 08 02:17:28.451117 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:17:28.451117 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:17:28.451117 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:17:28.451117 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:17:28.451117 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:17:28.451117 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:17:28.451117 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:17:28.451117 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:17:28.451117 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:17:28.451117 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:17:28.451117 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78009a5e-d759-4faf-8ef4-fe4d5612a690 could not be found. Jun 08 02:17:28.451117 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:17:28.451117 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:17:28.451117 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:17:28.451117 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:17:28.451117 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:17:28.451117 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:17:28.451117 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:17:28.451117 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:17:28.451117 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:17:28.452343 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:17:28.452343 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 02:17:28.452343 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 02:17:28.452343 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:17:28.452343 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:17:28.452343 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:17:28.452343 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:17:28.452343 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78009a5e-d759-4faf-8ef4-fe4d5612a690 could not be found. Jun 08 02:17:28.452343 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:17:28.452343 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:17:28.452343 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:17:28.452343 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:17:28.452343 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:17:28.452343 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:17:28.452343 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:17:28.452343 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:17:28.452343 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78009a5e-d759-4faf-8ef4-fe4d5612a690 could not be found. Jun 08 02:17:28.452343 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:17:28.453606 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7d5b004e-6852-4102-ab76-94440c787001 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] Returning 404 to user: Instance 78009a5e-d759-4faf-8ef4-fe4d5612a690 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:17:28.453606 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7d5b004e-6852-4102-ab76-94440c787001 tempest-AttachVolumeNegativeTest-695083649 tempest-AttachVolumeNegativeTest-695083649-project] 10.222.0.20 "GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690" status: 404 len: 111 microversion: 2.1 time: 0.029100 Jun 08 02:17:28.453606 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 490/995] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:17:28 2022] GET /compute/v2.1/servers/78009a5e-d759-4faf-8ef4-fe4d5612a690 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 02:17:29.092238 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-6091eb2b-364f-4563-9f34-3a7f8baf6eee tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:29.093112 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-6091eb2b-364f-4563-9f34-3a7f8baf6eee tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:29.099287 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6091eb2b-364f-4563-9f34-3a7f8baf6eee tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:29.099740 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6091eb2b-364f-4563-9f34-3a7f8baf6eee tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:29.100588 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6091eb2b-364f-4563-9f34-3a7f8baf6eee tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:29.101254 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6091eb2b-364f-4563-9f34-3a7f8baf6eee tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:29.114410 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-6c431eda-1f23-43d0-ae6c-44c58da5ce66 req-d6cf84dd-3c5f-4348-a772-25fdf5c2c8ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de", "name": "network-vif-plugged", "status": "completed", "tag": "32f4531c-b75e-4816-9d56-731d8bac1cd2"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:17:29.126809 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-6c431eda-1f23-43d0-ae6c-44c58da5ce66 req-d6cf84dd-3c5f-4348-a772-25fdf5c2c8ee service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:29.127816 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-6c431eda-1f23-43d0-ae6c-44c58da5ce66 req-d6cf84dd-3c5f-4348-a772-25fdf5c2c8ee service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:29.145758 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-6c431eda-1f23-43d0-ae6c-44c58da5ce66 req-d6cf84dd-3c5f-4348-a772-25fdf5c2c8ee service nova] Creating event network-vif-plugged:32f4531c-b75e-4816-9d56-731d8bac1cd2 for instance ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de on hv-cinder-84506 Jun 08 02:17:29.151518 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-6c431eda-1f23-43d0-ae6c-44c58da5ce66 req-d6cf84dd-3c5f-4348-a772-25fdf5c2c8ee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041139 Jun 08 02:17:29.152206 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 491/996] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 02:17:29.336821 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-6091eb2b-364f-4563-9f34-3a7f8baf6eee tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:17:29.340796 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:17:29.347168 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-6091eb2b-364f-4563-9f34-3a7f8baf6eee tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de" status: 200 len: 1265 microversion: 2.1 time: 0.259570 Jun 08 02:17:29.347820 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 506/997] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:17:29 2022] GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de => generated 1265 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:17:30.366129 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6658244b-4e03-4cb9-a932-6af7b4c73bce tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:30.366776 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6658244b-4e03-4cb9-a932-6af7b4c73bce tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:30.373707 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6658244b-4e03-4cb9-a932-6af7b4c73bce tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:30.374422 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6658244b-4e03-4cb9-a932-6af7b4c73bce tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:30.375514 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6658244b-4e03-4cb9-a932-6af7b4c73bce tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:30.376116 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6658244b-4e03-4cb9-a932-6af7b4c73bce tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:30.594214 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6658244b-4e03-4cb9-a932-6af7b4c73bce tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:17:30.602302 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6658244b-4e03-4cb9-a932-6af7b4c73bce tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de" status: 200 len: 1265 microversion: 2.1 time: 0.241287 Jun 08 02:17:30.603132 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 492/998] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:17:30 2022] GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:17:31.622784 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e0f086b9-c123-4be9-a248-8e397d7034a6 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:31.623402 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e0f086b9-c123-4be9-a248-8e397d7034a6 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:31.630717 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e0f086b9-c123-4be9-a248-8e397d7034a6 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:31.631506 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e0f086b9-c123-4be9-a248-8e397d7034a6 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:31.632484 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e0f086b9-c123-4be9-a248-8e397d7034a6 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:31.633173 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e0f086b9-c123-4be9-a248-8e397d7034a6 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:31.883719 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e0f086b9-c123-4be9-a248-8e397d7034a6 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:17:31.892469 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e0f086b9-c123-4be9-a248-8e397d7034a6 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de" status: 200 len: 1453 microversion: 2.1 time: 0.276677 Jun 08 02:17:31.893284 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 507/999] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:17:31 2022] GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de => generated 1453 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:17:31.910701 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-791ab8f4-df8b-4c6b-9933-26cbdbd28660 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:17:31.913075 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-791ab8f4-df8b-4c6b-9933-26cbdbd28660 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:17:31.934123 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-791ab8f4-df8b-4c6b-9933-26cbdbd28660 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:31.935584 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-791ab8f4-df8b-4c6b-9933-26cbdbd28660 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:31.936254 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-791ab8f4-df8b-4c6b-9933-26cbdbd28660 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:31.937684 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-791ab8f4-df8b-4c6b-9933-26cbdbd28660 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:32.079736 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-791ab8f4-df8b-4c6b-9933-26cbdbd28660 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:17:32.087282 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-791ab8f4-df8b-4c6b-9933-26cbdbd28660 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de" status: 200 len: 1453 microversion: 2.1 time: 0.181235 Jun 08 02:17:32.088191 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 493/1000] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:17:31 2022] GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de => generated 1453 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:17:34.033712 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-8701e20c-37eb-4984-81a2-67da75d19ef1 req-03b6dd5f-3d14-4bb2-9306-e408ba815370 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de", "tag": "32f4531c-b75e-4816-9d56-731d8bac1cd2"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:17:34.042714 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-8701e20c-37eb-4984-81a2-67da75d19ef1 req-03b6dd5f-3d14-4bb2-9306-e408ba815370 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:17:34.043159 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-8701e20c-37eb-4984-81a2-67da75d19ef1 req-03b6dd5f-3d14-4bb2-9306-e408ba815370 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:17:34.055568 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-8701e20c-37eb-4984-81a2-67da75d19ef1 req-03b6dd5f-3d14-4bb2-9306-e408ba815370 service nova] Creating event network-changed:32f4531c-b75e-4816-9d56-731d8bac1cd2 for instance ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de on hv-cinder-84506 Jun 08 02:17:34.061366 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-8701e20c-37eb-4984-81a2-67da75d19ef1 req-03b6dd5f-3d14-4bb2-9306-e408ba815370 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032167 Jun 08 02:17:34.062298 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 508/1001] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:18:20.482043 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-64d9dba3-61d7-4185-8daf-898ff2118e57 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-937714192", "imageRef": "e648e482-e374-429d-8152-a4a63797f314", "flavorRef": "452"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:18:20.487630 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:18:20.488287 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=22 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:18:20.539565 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.network.neutron [None req-64d9dba3-61d7-4185-8daf-898ff2118e57 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] validate_networks() for None {{(pid=117938) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 02:18:20.811902 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-64d9dba3-61d7-4185-8daf-898ff2118e57 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Flavor limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 02:18:20.812321 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-64d9dba3-61d7-4185-8daf-898ff2118e57 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Image limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 02:18:20.812821 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-64d9dba3-61d7-4185-8daf-898ff2118e57 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Flavor pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 02:18:20.813226 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-64d9dba3-61d7-4185-8daf-898ff2118e57 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Image pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 02:18:20.813634 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-64d9dba3-61d7-4185-8daf-898ff2118e57 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 02:18:20.822228 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-64d9dba3-61d7-4185-8daf-898ff2118e57 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:18:20.822665 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-64d9dba3-61d7-4185-8daf-898ff2118e57 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:18:20.823450 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-64d9dba3-61d7-4185-8daf-898ff2118e57 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:18:20.823878 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-64d9dba3-61d7-4185-8daf-898ff2118e57 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:18:20.841504 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-64d9dba3-61d7-4185-8daf-898ff2118e57 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Getting quotas for project 741042da56d346c8993f525a73c443f9. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 02:18:20.845324 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-64d9dba3-61d7-4185-8daf-898ff2118e57 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Getting quotas for user eafd60434a7c4a8b83c77227949bc3ff and project 741042da56d346c8993f525a73c443f9. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 02:18:20.855880 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-64d9dba3-61d7-4185-8daf-898ff2118e57 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Going to run 1 instances... {{(pid=117938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 02:18:20.858700 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-64d9dba3-61d7-4185-8daf-898ff2118e57 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] [instance: 77d91287-5247-43bf-ba8b-f6143090b77f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e648e482-e374-429d-8152-a4a63797f314',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 02:18:20.901637 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-64d9dba3-61d7-4185-8daf-898ff2118e57 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.423586 Jun 08 02:18:20.902272 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 494/1002] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jun 8 02:18:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 425 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 08 02:18:20.910488 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=48 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:18:20.911673 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=8 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:18:20.916872 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d6a373e9-c79f-4888-bb38-32b2e399ab9b tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:18:20.917676 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d6a373e9-c79f-4888-bb38-32b2e399ab9b tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] [instance: 77d91287-5247-43bf-ba8b-f6143090b77f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:18:20.973795 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d6a373e9-c79f-4888-bb38-32b2e399ab9b tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafd60434a7c4a8b83c77227949bc3ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741042da56d346c8993f525a73c443f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:18:20.980547 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d6a373e9-c79f-4888-bb38-32b2e399ab9b tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] 10.222.0.20 "GET /compute/v2.1/servers/77d91287-5247-43bf-ba8b-f6143090b77f" status: 200 len: 1214 microversion: 2.1 time: 0.071993 Jun 08 02:18:20.981108 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 509/1003] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:18:20 2022] GET /compute/v2.1/servers/77d91287-5247-43bf-ba8b-f6143090b77f => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:18:21.999590 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-37fd6adc-300c-42de-b9bb-da93ea9f88d6 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:18:22.000723 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-37fd6adc-300c-42de-b9bb-da93ea9f88d6 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] [instance: 77d91287-5247-43bf-ba8b-f6143090b77f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:18:22.008992 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-37fd6adc-300c-42de-b9bb-da93ea9f88d6 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:18:22.009444 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-37fd6adc-300c-42de-b9bb-da93ea9f88d6 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:18:22.011529 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-37fd6adc-300c-42de-b9bb-da93ea9f88d6 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:18:22.011807 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-37fd6adc-300c-42de-b9bb-da93ea9f88d6 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:18:22.087529 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-37fd6adc-300c-42de-b9bb-da93ea9f88d6 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafd60434a7c4a8b83c77227949bc3ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741042da56d346c8993f525a73c443f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:18:22.095627 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-37fd6adc-300c-42de-b9bb-da93ea9f88d6 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] 10.222.0.20 "GET /compute/v2.1/servers/77d91287-5247-43bf-ba8b-f6143090b77f" status: 200 len: 1272 microversion: 2.1 time: 0.101776 Jun 08 02:18:22.096196 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 495/1004] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:18:21 2022] GET /compute/v2.1/servers/77d91287-5247-43bf-ba8b-f6143090b77f => generated 1272 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:18:23.113404 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-127c15f4-acd8-4731-b396-6b0aaf2d583b tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:18:23.114099 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-127c15f4-acd8-4731-b396-6b0aaf2d583b tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] [instance: 77d91287-5247-43bf-ba8b-f6143090b77f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:18:23.120894 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-127c15f4-acd8-4731-b396-6b0aaf2d583b tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:18:23.121466 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-127c15f4-acd8-4731-b396-6b0aaf2d583b tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:18:23.123147 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-127c15f4-acd8-4731-b396-6b0aaf2d583b tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:18:23.123700 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-127c15f4-acd8-4731-b396-6b0aaf2d583b tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:18:23.317658 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-127c15f4-acd8-4731-b396-6b0aaf2d583b tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafd60434a7c4a8b83c77227949bc3ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741042da56d346c8993f525a73c443f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:18:23.326541 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-127c15f4-acd8-4731-b396-6b0aaf2d583b tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] 10.222.0.20 "GET /compute/v2.1/servers/77d91287-5247-43bf-ba8b-f6143090b77f" status: 200 len: 1314 microversion: 2.1 time: 0.215996 Jun 08 02:18:23.327370 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 510/1005] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:18:23 2022] GET /compute/v2.1/servers/77d91287-5247-43bf-ba8b-f6143090b77f => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:18:23.408551 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-73029288-a2b7-4532-b715-1d2f88250426 req-10e6d9b5-5fe4-4a23-abbd-66b5477e2a27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77d91287-5247-43bf-ba8b-f6143090b77f", "tag": "15fe8425-ecc5-423e-9601-434810776fc3"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:18:23.419616 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-73029288-a2b7-4532-b715-1d2f88250426 req-10e6d9b5-5fe4-4a23-abbd-66b5477e2a27 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:18:23.420664 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-73029288-a2b7-4532-b715-1d2f88250426 req-10e6d9b5-5fe4-4a23-abbd-66b5477e2a27 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:18:23.436606 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-73029288-a2b7-4532-b715-1d2f88250426 req-10e6d9b5-5fe4-4a23-abbd-66b5477e2a27 service nova] Creating event network-changed:15fe8425-ecc5-423e-9601-434810776fc3 for instance 77d91287-5247-43bf-ba8b-f6143090b77f on hv-cinder-84506 Jun 08 02:18:23.442469 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-73029288-a2b7-4532-b715-1d2f88250426 req-10e6d9b5-5fe4-4a23-abbd-66b5477e2a27 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040480 Jun 08 02:18:23.443418 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 496/1006] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:18:24.343677 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-703e7250-d0ef-4c17-a4d8-67710510eb8c tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:18:24.344279 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-703e7250-d0ef-4c17-a4d8-67710510eb8c tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] [instance: 77d91287-5247-43bf-ba8b-f6143090b77f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:18:24.350855 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-703e7250-d0ef-4c17-a4d8-67710510eb8c tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:18:24.351306 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-703e7250-d0ef-4c17-a4d8-67710510eb8c tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:18:24.352052 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-703e7250-d0ef-4c17-a4d8-67710510eb8c tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:18:24.352506 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-703e7250-d0ef-4c17-a4d8-67710510eb8c tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:18:24.485676 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-703e7250-d0ef-4c17-a4d8-67710510eb8c tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafd60434a7c4a8b83c77227949bc3ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741042da56d346c8993f525a73c443f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:18:24.493303 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-703e7250-d0ef-4c17-a4d8-67710510eb8c tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] 10.222.0.20 "GET /compute/v2.1/servers/77d91287-5247-43bf-ba8b-f6143090b77f" status: 200 len: 1314 microversion: 2.1 time: 0.154137 Jun 08 02:18:24.493869 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 511/1007] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:18:24 2022] GET /compute/v2.1/servers/77d91287-5247-43bf-ba8b-f6143090b77f => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:18:25.511255 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6826a726-b136-44d0-8554-e15a412c577e tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:18:25.512075 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6826a726-b136-44d0-8554-e15a412c577e tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] [instance: 77d91287-5247-43bf-ba8b-f6143090b77f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:18:25.519590 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6826a726-b136-44d0-8554-e15a412c577e tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:18:25.520044 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6826a726-b136-44d0-8554-e15a412c577e tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:18:25.520858 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6826a726-b136-44d0-8554-e15a412c577e tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:18:25.521298 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6826a726-b136-44d0-8554-e15a412c577e tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:18:25.654375 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6826a726-b136-44d0-8554-e15a412c577e tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafd60434a7c4a8b83c77227949bc3ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741042da56d346c8993f525a73c443f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:18:25.661793 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6826a726-b136-44d0-8554-e15a412c577e tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] 10.222.0.20 "GET /compute/v2.1/servers/77d91287-5247-43bf-ba8b-f6143090b77f" status: 200 len: 1314 microversion: 2.1 time: 0.154841 Jun 08 02:18:25.662354 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 497/1008] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:18:25 2022] GET /compute/v2.1/servers/77d91287-5247-43bf-ba8b-f6143090b77f => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:18:26.679413 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-5e86efd6-f3e3-4cb3-8b37-d2743bc5a39d tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:18:26.680007 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-5e86efd6-f3e3-4cb3-8b37-d2743bc5a39d tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] [instance: 77d91287-5247-43bf-ba8b-f6143090b77f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:18:26.687044 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5e86efd6-f3e3-4cb3-8b37-d2743bc5a39d tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:18:26.687497 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5e86efd6-f3e3-4cb3-8b37-d2743bc5a39d tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:18:26.688261 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5e86efd6-f3e3-4cb3-8b37-d2743bc5a39d tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:18:26.688718 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5e86efd6-f3e3-4cb3-8b37-d2743bc5a39d tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:18:26.816563 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-5e86efd6-f3e3-4cb3-8b37-d2743bc5a39d tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafd60434a7c4a8b83c77227949bc3ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741042da56d346c8993f525a73c443f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:18:26.823810 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-5e86efd6-f3e3-4cb3-8b37-d2743bc5a39d tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] 10.222.0.20 "GET /compute/v2.1/servers/77d91287-5247-43bf-ba8b-f6143090b77f" status: 200 len: 1314 microversion: 2.1 time: 0.148303 Jun 08 02:18:26.824363 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 512/1009] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:18:26 2022] GET /compute/v2.1/servers/77d91287-5247-43bf-ba8b-f6143090b77f => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:18:27.456960 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-6942159f-a295-4f95-b542-2445bd2ed9f3 req-3af1f6e4-0cf4-430f-939f-71d631699c0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d91287-5247-43bf-ba8b-f6143090b77f", "name": "network-vif-plugged", "status": "completed", "tag": "15fe8425-ecc5-423e-9601-434810776fc3"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:18:27.470594 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-6942159f-a295-4f95-b542-2445bd2ed9f3 req-3af1f6e4-0cf4-430f-939f-71d631699c0e service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:18:27.471113 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-6942159f-a295-4f95-b542-2445bd2ed9f3 req-3af1f6e4-0cf4-430f-939f-71d631699c0e service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:18:27.483150 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-6942159f-a295-4f95-b542-2445bd2ed9f3 req-3af1f6e4-0cf4-430f-939f-71d631699c0e service nova] Creating event network-vif-plugged:15fe8425-ecc5-423e-9601-434810776fc3 for instance 77d91287-5247-43bf-ba8b-f6143090b77f on hv-cinder-84506 Jun 08 02:18:27.487978 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-6942159f-a295-4f95-b542-2445bd2ed9f3 req-3af1f6e4-0cf4-430f-939f-71d631699c0e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037614 Jun 08 02:18:27.488600 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 498/1010] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:18:27.841775 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-fe4d2985-947a-4a90-8099-9bd844dc3083 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:18:27.842322 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-fe4d2985-947a-4a90-8099-9bd844dc3083 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] [instance: 77d91287-5247-43bf-ba8b-f6143090b77f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:18:27.848754 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fe4d2985-947a-4a90-8099-9bd844dc3083 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:18:27.849201 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fe4d2985-947a-4a90-8099-9bd844dc3083 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:18:27.849955 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fe4d2985-947a-4a90-8099-9bd844dc3083 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:18:27.850388 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fe4d2985-947a-4a90-8099-9bd844dc3083 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:18:27.977854 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-fe4d2985-947a-4a90-8099-9bd844dc3083 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafd60434a7c4a8b83c77227949bc3ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741042da56d346c8993f525a73c443f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:18:27.985887 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-fe4d2985-947a-4a90-8099-9bd844dc3083 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] 10.222.0.20 "GET /compute/v2.1/servers/77d91287-5247-43bf-ba8b-f6143090b77f" status: 200 len: 1314 microversion: 2.1 time: 0.148564 Jun 08 02:18:27.986453 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 513/1011] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:18:27 2022] GET /compute/v2.1/servers/77d91287-5247-43bf-ba8b-f6143090b77f => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:18:29.003846 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-51fab5f6-47ea-49ff-aec2-f660ea524b0a tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:18:29.004569 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-51fab5f6-47ea-49ff-aec2-f660ea524b0a tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] [instance: 77d91287-5247-43bf-ba8b-f6143090b77f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:18:29.010768 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-51fab5f6-47ea-49ff-aec2-f660ea524b0a tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:18:29.011213 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-51fab5f6-47ea-49ff-aec2-f660ea524b0a tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:18:29.011970 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-51fab5f6-47ea-49ff-aec2-f660ea524b0a tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:18:29.012416 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-51fab5f6-47ea-49ff-aec2-f660ea524b0a tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:18:29.145863 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-51fab5f6-47ea-49ff-aec2-f660ea524b0a tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafd60434a7c4a8b83c77227949bc3ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741042da56d346c8993f525a73c443f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:18:29.153298 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-51fab5f6-47ea-49ff-aec2-f660ea524b0a tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] 10.222.0.20 "GET /compute/v2.1/servers/77d91287-5247-43bf-ba8b-f6143090b77f" status: 200 len: 1314 microversion: 2.1 time: 0.154488 Jun 08 02:18:29.154506 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 499/1012] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:18:28 2022] GET /compute/v2.1/servers/77d91287-5247-43bf-ba8b-f6143090b77f => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:18:30.171770 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-827a52a9-cefc-45e7-a992-5d534e8310d6 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:18:30.172309 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-827a52a9-cefc-45e7-a992-5d534e8310d6 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] [instance: 77d91287-5247-43bf-ba8b-f6143090b77f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:18:30.178808 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-827a52a9-cefc-45e7-a992-5d534e8310d6 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:18:30.179251 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-827a52a9-cefc-45e7-a992-5d534e8310d6 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:18:30.180006 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-827a52a9-cefc-45e7-a992-5d534e8310d6 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:18:30.180463 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-827a52a9-cefc-45e7-a992-5d534e8310d6 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:18:30.349164 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-827a52a9-cefc-45e7-a992-5d534e8310d6 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafd60434a7c4a8b83c77227949bc3ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741042da56d346c8993f525a73c443f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:18:30.357614 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-827a52a9-cefc-45e7-a992-5d534e8310d6 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] 10.222.0.20 "GET /compute/v2.1/servers/77d91287-5247-43bf-ba8b-f6143090b77f" status: 200 len: 1464 microversion: 2.1 time: 0.189847 Jun 08 02:18:30.358339 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 514/1013] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:18:30 2022] GET /compute/v2.1/servers/77d91287-5247-43bf-ba8b-f6143090b77f => generated 1464 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:18:30.396134 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cfec51b2-5e32-442c-a24c-62835bdccec8 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:18:30.396719 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-cfec51b2-5e32-442c-a24c-62835bdccec8 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] [instance: 77d91287-5247-43bf-ba8b-f6143090b77f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:18:30.403020 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cfec51b2-5e32-442c-a24c-62835bdccec8 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:18:30.404049 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cfec51b2-5e32-442c-a24c-62835bdccec8 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:18:30.405019 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cfec51b2-5e32-442c-a24c-62835bdccec8 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:18:30.405452 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cfec51b2-5e32-442c-a24c-62835bdccec8 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:18:30.431375 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-cfec51b2-5e32-442c-a24c-62835bdccec8 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] [instance: 77d91287-5247-43bf-ba8b-f6143090b77f] Going to try to terminate instance {{(pid=117938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 02:18:30.510940 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-cfec51b2-5e32-442c-a24c-62835bdccec8 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] 10.222.0.20 "DELETE /compute/v2.1/servers/77d91287-5247-43bf-ba8b-f6143090b77f" status: 204 len: 0 microversion: 2.1 time: 0.118368 Jun 08 02:18:30.511750 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 500/1014] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jun 8 02:18:30 2022] DELETE /compute/v2.1/servers/77d91287-5247-43bf-ba8b-f6143090b77f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 08 02:18:30.521173 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-808f1843-1ec2-4c7b-aa9d-7a813658a06f tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:18:30.521779 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-808f1843-1ec2-4c7b-aa9d-7a813658a06f tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] [instance: 77d91287-5247-43bf-ba8b-f6143090b77f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:18:30.527740 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-808f1843-1ec2-4c7b-aa9d-7a813658a06f tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:18:30.528170 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-808f1843-1ec2-4c7b-aa9d-7a813658a06f tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:18:30.529161 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-808f1843-1ec2-4c7b-aa9d-7a813658a06f tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:18:30.529601 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-808f1843-1ec2-4c7b-aa9d-7a813658a06f tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:18:30.660309 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-808f1843-1ec2-4c7b-aa9d-7a813658a06f tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafd60434a7c4a8b83c77227949bc3ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741042da56d346c8993f525a73c443f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:18:30.667934 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-808f1843-1ec2-4c7b-aa9d-7a813658a06f tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] 10.222.0.20 "GET /compute/v2.1/servers/77d91287-5247-43bf-ba8b-f6143090b77f" status: 200 len: 1470 microversion: 2.1 time: 0.150697 Jun 08 02:18:30.668518 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 515/1015] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:18:30 2022] GET /compute/v2.1/servers/77d91287-5247-43bf-ba8b-f6143090b77f => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:18:31.686477 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-122ca0b3-d34a-4bd8-952d-6577b18be9ee tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:18:31.687176 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-122ca0b3-d34a-4bd8-952d-6577b18be9ee tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] [instance: 77d91287-5247-43bf-ba8b-f6143090b77f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:18:31.689105 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:18:31.689750 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=6 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:18:31.695886 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-122ca0b3-d34a-4bd8-952d-6577b18be9ee tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:18:31.696332 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-122ca0b3-d34a-4bd8-952d-6577b18be9ee tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:18:31.697132 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-122ca0b3-d34a-4bd8-952d-6577b18be9ee tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:18:31.697571 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-122ca0b3-d34a-4bd8-952d-6577b18be9ee tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:18:31.887066 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-122ca0b3-d34a-4bd8-952d-6577b18be9ee tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafd60434a7c4a8b83c77227949bc3ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741042da56d346c8993f525a73c443f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:18:31.894704 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-122ca0b3-d34a-4bd8-952d-6577b18be9ee tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] 10.222.0.20 "GET /compute/v2.1/servers/77d91287-5247-43bf-ba8b-f6143090b77f" status: 200 len: 1470 microversion: 2.1 time: 0.212502 Jun 08 02:18:31.895277 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 501/1016] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:18:31 2022] GET /compute/v2.1/servers/77d91287-5247-43bf-ba8b-f6143090b77f => generated 1470 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:18:32.768316 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-884f2f08-7e39-42c5-9a39-9c8eda90dd91 req-c5404b24-c3ef-4f87-8234-9b261f6ef2ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d91287-5247-43bf-ba8b-f6143090b77f", "name": "network-vif-deleted", "tag": "15fe8425-ecc5-423e-9601-434810776fc3"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:18:32.772158 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=2 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:18:32.778631 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-884f2f08-7e39-42c5-9a39-9c8eda90dd91 req-c5404b24-c3ef-4f87-8234-9b261f6ef2ef service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:18:32.779088 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-884f2f08-7e39-42c5-9a39-9c8eda90dd91 req-c5404b24-c3ef-4f87-8234-9b261f6ef2ef service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:18:32.791860 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-884f2f08-7e39-42c5-9a39-9c8eda90dd91 req-c5404b24-c3ef-4f87-8234-9b261f6ef2ef service nova] Creating event network-vif-deleted:15fe8425-ecc5-423e-9601-434810776fc3 for instance 77d91287-5247-43bf-ba8b-f6143090b77f on hv-cinder-84506 Jun 08 02:18:32.798434 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-884f2f08-7e39-42c5-9a39-9c8eda90dd91 req-c5404b24-c3ef-4f87-8234-9b261f6ef2ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033967 Jun 08 02:18:32.799826 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 516/1017] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:18:32.912558 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-96442d18-f81f-40f2-8427-0d94c2988c03 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:18:32.913172 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-96442d18-f81f-40f2-8427-0d94c2988c03 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] [instance: 77d91287-5247-43bf-ba8b-f6143090b77f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:18:32.920747 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-96442d18-f81f-40f2-8427-0d94c2988c03 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:18:32.921195 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-96442d18-f81f-40f2-8427-0d94c2988c03 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:18:32.921961 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-96442d18-f81f-40f2-8427-0d94c2988c03 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:18:32.922406 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-96442d18-f81f-40f2-8427-0d94c2988c03 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:18:32.954223 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-96442d18-f81f-40f2-8427-0d94c2988c03 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:18:32.954724 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-96442d18-f81f-40f2-8427-0d94c2988c03 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:18:32.955108 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-96442d18-f81f-40f2-8427-0d94c2988c03 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lazy-loading 'fault' on Instance uuid 77d91287-5247-43bf-ba8b-f6143090b77f {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 02:18:32.995272 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-96442d18-f81f-40f2-8427-0d94c2988c03 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafd60434a7c4a8b83c77227949bc3ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741042da56d346c8993f525a73c443f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:18:33.010234 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-96442d18-f81f-40f2-8427-0d94c2988c03 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] 10.222.0.20 "GET /compute/v2.1/servers/77d91287-5247-43bf-ba8b-f6143090b77f" status: 200 len: 1304 microversion: 2.1 time: 0.094829 Jun 08 02:18:33.011274 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 502/1018] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:18:32 2022] GET /compute/v2.1/servers/77d91287-5247-43bf-ba8b-f6143090b77f => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:18:34.027588 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d34ae866-2279-4e9d-a43c-bb0b304ad9f1 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:18:34.028287 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d34ae866-2279-4e9d-a43c-bb0b304ad9f1 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] [instance: 77d91287-5247-43bf-ba8b-f6143090b77f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:18:34.035692 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d34ae866-2279-4e9d-a43c-bb0b304ad9f1 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:18:34.036138 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d34ae866-2279-4e9d-a43c-bb0b304ad9f1 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:18:34.036926 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d34ae866-2279-4e9d-a43c-bb0b304ad9f1 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:18:34.037361 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d34ae866-2279-4e9d-a43c-bb0b304ad9f1 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:18:34.050619 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-d34ae866-2279-4e9d-a43c-bb0b304ad9f1 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] HTTP exception thrown: Instance 77d91287-5247-43bf-ba8b-f6143090b77f could not be found. Jun 08 02:18:34.052209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d34ae866-2279-4e9d-a43c-bb0b304ad9f1 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Request method failure captured: Jun 08 02:18:34.052209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/77d91287-5247-43bf-ba8b-f6143090b77f HTTP/1.1 Jun 08 02:18:34.052209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept: application/json Jun 08 02:18:34.052209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jun 08 02:18:34.052209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Connection: close Jun 08 02:18:34.052209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jun 08 02:18:34.052209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jun 08 02:18:34.052209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Host: 10.222.0.20 Jun 08 02:18:34.052209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jun 08 02:18:34.052209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jun 08 02:18:34.052209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABioAbq_ramcTFFQW6Yx2ykXDv-onk4ru7OmCF8Hy8MsJlNrC5FQt3Dh6iqWEQH8nbplWXv2jwKnWe4ByO_LL1N73NIJb1-FaU-ozrvR9AG27TFxr4y_oLryKRx0XxOEWzTRhJUvS9cNvGVVMz2cd6usDqV00qGj_rr48Gfc1cL4oqM6co Jun 08 02:18:34.052209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jun 08 02:18:34.052209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jun 08 02:18:34.052209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jun 08 02:18:34.052209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jun 08 02:18:34.052209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jun 08 02:18:34.052209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jun 08 02:18:34.052209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Id: 741042da56d346c8993f525a73c443f9 Jun 08 02:18:34.052209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-VolumesNegativeTest-777648337 Jun 08 02:18:34.052209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jun 08 02:18:34.052209 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jun 08 02:18:34.054035 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/741042da56d346c8993f525a73c443f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_741042da56d346c8993f525a73c443f9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/741042da56d346c8993f525a73c443f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/741042da56d346c8993f525a73c443f9"}]}] Jun 08 02:18:34.054035 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-VolumesNegativeTest-777648337 Jun 08 02:18:34.054035 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 741042da56d346c8993f525a73c443f9 Jun 08 02:18:34.054035 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-VolumesNegativeTest-777648337 Jun 08 02:18:34.054035 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User: tempest-VolumesNegativeTest-777648337-project Jun 08 02:18:34.054035 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jun 08 02:18:34.054035 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jun 08 02:18:34.054035 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Id: eafd60434a7c4a8b83c77227949bc3ff Jun 08 02:18:34.054035 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-VolumesNegativeTest-777648337-project Jun 08 02:18:34.054035 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: method: > Jun 08 02:18:34.054035 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: exception: Instance 77d91287-5247-43bf-ba8b-f6143090b77f could not be found. Jun 08 02:18:34.054035 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: action_args: {'id': '77d91287-5247-43bf-ba8b-f6143090b77f'} Jun 08 02:18:34.055164 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:18:34.055164 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:18:34.055164 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:18:34.055164 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:18:34.055164 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:18:34.055164 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:18:34.055164 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:18:34.055164 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:18:34.055164 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:18:34.055164 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:18:34.055164 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77d91287-5247-43bf-ba8b-f6143090b77f could not be found. Jun 08 02:18:34.055164 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:18:34.055164 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:18:34.055164 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:18:34.055164 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:18:34.055164 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:18:34.055164 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:18:34.055164 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:18:34.055164 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:18:34.055164 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:18:34.056732 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:18:34.056732 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 02:18:34.056732 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 02:18:34.056732 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:18:34.056732 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:18:34.056732 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:18:34.056732 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:18:34.056732 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77d91287-5247-43bf-ba8b-f6143090b77f could not be found. Jun 08 02:18:34.056732 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:18:34.056732 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:18:34.056732 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:18:34.056732 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:18:34.056732 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:18:34.056732 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:18:34.056732 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:18:34.056732 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:18:34.056732 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77d91287-5247-43bf-ba8b-f6143090b77f could not be found. Jun 08 02:18:34.056732 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:18:34.058139 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d34ae866-2279-4e9d-a43c-bb0b304ad9f1 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] Returning 404 to user: Instance 77d91287-5247-43bf-ba8b-f6143090b77f could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:18:34.058139 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d34ae866-2279-4e9d-a43c-bb0b304ad9f1 tempest-VolumesNegativeTest-777648337 tempest-VolumesNegativeTest-777648337-project] 10.222.0.20 "GET /compute/v2.1/servers/77d91287-5247-43bf-ba8b-f6143090b77f" status: 404 len: 111 microversion: 2.1 time: 0.030257 Jun 08 02:18:34.058139 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 517/1019] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:18:34 2022] GET /compute/v2.1/servers/77d91287-5247-43bf-ba8b-f6143090b77f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 02:19:06.117359 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 08 02:19:06.118001 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Wed Jun 8 02:19:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 08 02:19:09.147146 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-587bb079-1bc1-4692-9001-ec5c2e72c144 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1833990598", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-153398192", "security_groups": [{"name": "tempest-secgroup-smoke-1399273772"}], "block_device_mapping_v2": [{"uuid": "15e425c3-2223-4234-b684-4ab975de4eed", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "05318a5a-b32e-458e-9f7c-d5bc705960a2"}]}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:19:09.155768 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:19:09.156521 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:19:09.262148 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.network.neutron [None req-587bb079-1bc1-4692-9001-ec5c2e72c144 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] validate_networks() for [('05318a5a-b32e-458e-9f7c-d5bc705960a2', None, None, None, None, None)] {{(pid=117938) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 02:19:09.628834 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-587bb079-1bc1-4692-9001-ec5c2e72c144 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Flavor limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 02:19:09.629254 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-587bb079-1bc1-4692-9001-ec5c2e72c144 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Image limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 02:19:09.629719 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-587bb079-1bc1-4692-9001-ec5c2e72c144 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Flavor pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 02:19:09.630141 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-587bb079-1bc1-4692-9001-ec5c2e72c144 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Image pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 02:19:09.630546 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-587bb079-1bc1-4692-9001-ec5c2e72c144 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 02:19:09.652108 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-587bb079-1bc1-4692-9001-ec5c2e72c144 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:19:09.652622 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-587bb079-1bc1-4692-9001-ec5c2e72c144 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:19:09.653448 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-587bb079-1bc1-4692-9001-ec5c2e72c144 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:19:09.653884 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-587bb079-1bc1-4692-9001-ec5c2e72c144 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:19:09.686460 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-587bb079-1bc1-4692-9001-ec5c2e72c144 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Getting quotas for project 079027b24aba4a179f99de9f6fe944b8. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 02:19:09.691299 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-587bb079-1bc1-4692-9001-ec5c2e72c144 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Getting quotas for user 89e6c19fcc9f490c890fc4d6350273a0 and project 079027b24aba4a179f99de9f6fe944b8. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 02:19:09.748241 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-587bb079-1bc1-4692-9001-ec5c2e72c144 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Going to run 1 instances... {{(pid=117938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 02:19:09.750334 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-587bb079-1bc1-4692-9001-ec5c2e72c144 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: e7210079-900f-490c-96fe-f352bca49ca6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='15e425c3-2223-4234-b684-4ab975de4eed',volume_size=None,volume_type=None)] {{(pid=117938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 02:19:09.879003 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-587bb079-1bc1-4692-9001-ec5c2e72c144 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.735867 Jun 08 02:19:09.879633 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 503/1020] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jun 8 02:19:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 08 02:19:09.889225 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a02ccf5e-2e70-4309-9516-8753b7952938 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:19:09.889828 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a02ccf5e-2e70-4309-9516-8753b7952938 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: e7210079-900f-490c-96fe-f352bca49ca6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:19:09.893486 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=20 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:19:09.894120 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=40 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:19:09.947503 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a02ccf5e-2e70-4309-9516-8753b7952938 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:19:09.954165 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a02ccf5e-2e70-4309-9516-8753b7952938 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6" status: 200 len: 1094 microversion: 2.1 time: 0.068645 Jun 08 02:19:09.954816 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 518/1021] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:19:09 2022] GET /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:19:10.970546 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7b85ff3a-22be-4281-af92-c6ddd15f9067 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:19:10.971181 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7b85ff3a-22be-4281-af92-c6ddd15f9067 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: e7210079-900f-490c-96fe-f352bca49ca6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:19:10.977956 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7b85ff3a-22be-4281-af92-c6ddd15f9067 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:19:10.978640 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7b85ff3a-22be-4281-af92-c6ddd15f9067 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:19:10.979405 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7b85ff3a-22be-4281-af92-c6ddd15f9067 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:19:10.979840 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7b85ff3a-22be-4281-af92-c6ddd15f9067 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:19:11.051281 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7b85ff3a-22be-4281-af92-c6ddd15f9067 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:19:11.061055 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7b85ff3a-22be-4281-af92-c6ddd15f9067 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6" status: 200 len: 1210 microversion: 2.1 time: 0.094919 Jun 08 02:19:11.061952 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 504/1022] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:19:10 2022] GET /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6 => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:19:12.078195 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-40caaa06-c35b-4595-9a79-ac1110697cd3 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:19:12.078802 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-40caaa06-c35b-4595-9a79-ac1110697cd3 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: e7210079-900f-490c-96fe-f352bca49ca6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:19:12.087578 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-40caaa06-c35b-4595-9a79-ac1110697cd3 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:19:12.088291 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-40caaa06-c35b-4595-9a79-ac1110697cd3 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:19:12.089277 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-40caaa06-c35b-4595-9a79-ac1110697cd3 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:19:12.090447 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-40caaa06-c35b-4595-9a79-ac1110697cd3 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:19:12.277663 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-40caaa06-c35b-4595-9a79-ac1110697cd3 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:19:12.285990 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-40caaa06-c35b-4595-9a79-ac1110697cd3 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6" status: 200 len: 1266 microversion: 2.1 time: 0.211637 Jun 08 02:19:12.286528 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 519/1023] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:19:12 2022] GET /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:19:12.385008 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-f62ad294-5691-40e6-96e4-3f4a30c70d2b req-0611cf14-9de8-40d9-90d4-eff4861d345c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7210079-900f-490c-96fe-f352bca49ca6", "tag": "13b70bc3-9457-4544-a09b-b48fe66de285"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:19:12.401757 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-f62ad294-5691-40e6-96e4-3f4a30c70d2b req-0611cf14-9de8-40d9-90d4-eff4861d345c service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:19:12.402255 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-f62ad294-5691-40e6-96e4-3f4a30c70d2b req-0611cf14-9de8-40d9-90d4-eff4861d345c service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:19:12.419905 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-f62ad294-5691-40e6-96e4-3f4a30c70d2b req-0611cf14-9de8-40d9-90d4-eff4861d345c service nova] Creating event network-changed:13b70bc3-9457-4544-a09b-b48fe66de285 for instance e7210079-900f-490c-96fe-f352bca49ca6 on hv-cinder-84506 Jun 08 02:19:12.426531 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-f62ad294-5691-40e6-96e4-3f4a30c70d2b req-0611cf14-9de8-40d9-90d4-eff4861d345c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051711 Jun 08 02:19:12.427409 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 505/1024] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:19:13.304175 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e4268916-eb6b-4781-b21b-6aa59824e82c tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:19:13.304843 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e4268916-eb6b-4781-b21b-6aa59824e82c tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: e7210079-900f-490c-96fe-f352bca49ca6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:19:13.311625 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e4268916-eb6b-4781-b21b-6aa59824e82c tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:19:13.312068 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e4268916-eb6b-4781-b21b-6aa59824e82c tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:19:13.312865 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e4268916-eb6b-4781-b21b-6aa59824e82c tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:19:13.313291 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e4268916-eb6b-4781-b21b-6aa59824e82c tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:19:13.523661 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e4268916-eb6b-4781-b21b-6aa59824e82c tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:19:13.531220 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e4268916-eb6b-4781-b21b-6aa59824e82c tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6" status: 200 len: 1266 microversion: 2.1 time: 0.231316 Jun 08 02:19:13.531769 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 520/1025] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:19:13 2022] GET /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:19:14.549579 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-10847f9a-02f8-45d5-b07f-c0b8339bca70 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:19:14.550300 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-10847f9a-02f8-45d5-b07f-c0b8339bca70 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: e7210079-900f-490c-96fe-f352bca49ca6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:19:14.556962 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-10847f9a-02f8-45d5-b07f-c0b8339bca70 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:19:14.557416 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-10847f9a-02f8-45d5-b07f-c0b8339bca70 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:19:14.558170 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-10847f9a-02f8-45d5-b07f-c0b8339bca70 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:19:14.558603 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-10847f9a-02f8-45d5-b07f-c0b8339bca70 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:19:14.687473 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-10847f9a-02f8-45d5-b07f-c0b8339bca70 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:19:14.695399 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-10847f9a-02f8-45d5-b07f-c0b8339bca70 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6" status: 200 len: 1266 microversion: 2.1 time: 0.150131 Jun 08 02:19:14.695955 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 506/1026] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:19:14 2022] GET /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:19:15.711882 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-6e42a66e-08ca-46fe-a306-435a8bce4ab5 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:19:15.712530 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-6e42a66e-08ca-46fe-a306-435a8bce4ab5 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: e7210079-900f-490c-96fe-f352bca49ca6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:19:15.718944 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6e42a66e-08ca-46fe-a306-435a8bce4ab5 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:19:15.719421 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6e42a66e-08ca-46fe-a306-435a8bce4ab5 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:19:15.720314 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6e42a66e-08ca-46fe-a306-435a8bce4ab5 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:19:15.720778 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6e42a66e-08ca-46fe-a306-435a8bce4ab5 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:19:15.851524 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-6e42a66e-08ca-46fe-a306-435a8bce4ab5 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:19:15.858929 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-6e42a66e-08ca-46fe-a306-435a8bce4ab5 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6" status: 200 len: 1266 microversion: 2.1 time: 0.150923 Jun 08 02:19:15.859483 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 521/1027] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:19:15 2022] GET /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:19:16.875020 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0468680f-25e7-4e78-b5fe-eb06ae6be627 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:19:16.875650 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0468680f-25e7-4e78-b5fe-eb06ae6be627 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: e7210079-900f-490c-96fe-f352bca49ca6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:19:16.882747 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0468680f-25e7-4e78-b5fe-eb06ae6be627 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:19:16.883187 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0468680f-25e7-4e78-b5fe-eb06ae6be627 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:19:16.883939 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0468680f-25e7-4e78-b5fe-eb06ae6be627 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:19:16.884367 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0468680f-25e7-4e78-b5fe-eb06ae6be627 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:19:17.011646 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0468680f-25e7-4e78-b5fe-eb06ae6be627 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:19:17.019695 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0468680f-25e7-4e78-b5fe-eb06ae6be627 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6" status: 200 len: 1266 microversion: 2.1 time: 0.148514 Jun 08 02:19:17.020253 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 507/1028] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:19:16 2022] GET /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:19:18.037271 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-5f2090cc-4a8d-41cf-a35b-4a94532503f4 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:19:18.037876 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-5f2090cc-4a8d-41cf-a35b-4a94532503f4 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: e7210079-900f-490c-96fe-f352bca49ca6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:19:18.044521 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5f2090cc-4a8d-41cf-a35b-4a94532503f4 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:19:18.044950 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5f2090cc-4a8d-41cf-a35b-4a94532503f4 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:19:18.045699 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5f2090cc-4a8d-41cf-a35b-4a94532503f4 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:19:18.046126 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5f2090cc-4a8d-41cf-a35b-4a94532503f4 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:19:18.173647 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-5f2090cc-4a8d-41cf-a35b-4a94532503f4 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:19:18.180991 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-5f2090cc-4a8d-41cf-a35b-4a94532503f4 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6" status: 200 len: 1266 microversion: 2.1 time: 0.147902 Jun 08 02:19:18.181538 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 522/1029] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:19:18 2022] GET /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:19:19.197507 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4c66eec8-7a4b-488a-ade0-fbea91765caa tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:19:19.198046 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4c66eec8-7a4b-488a-ade0-fbea91765caa tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: e7210079-900f-490c-96fe-f352bca49ca6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:19:19.204705 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4c66eec8-7a4b-488a-ade0-fbea91765caa tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:19:19.205150 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4c66eec8-7a4b-488a-ade0-fbea91765caa tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:19:19.205906 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4c66eec8-7a4b-488a-ade0-fbea91765caa tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:19:19.206340 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4c66eec8-7a4b-488a-ade0-fbea91765caa tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:19:19.336118 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4c66eec8-7a4b-488a-ade0-fbea91765caa tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:19:19.343583 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4c66eec8-7a4b-488a-ade0-fbea91765caa tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6" status: 200 len: 1266 microversion: 2.1 time: 0.149997 Jun 08 02:19:19.344141 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 508/1030] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:19:19 2022] GET /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:19:20.360796 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-3e200641-8edc-4902-b5d0-ffdfee6cd452 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:19:20.361483 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-3e200641-8edc-4902-b5d0-ffdfee6cd452 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: e7210079-900f-490c-96fe-f352bca49ca6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:19:20.363807 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=2 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:19:20.369340 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3e200641-8edc-4902-b5d0-ffdfee6cd452 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:19:20.369785 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3e200641-8edc-4902-b5d0-ffdfee6cd452 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:19:20.370540 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3e200641-8edc-4902-b5d0-ffdfee6cd452 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:19:20.370967 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3e200641-8edc-4902-b5d0-ffdfee6cd452 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:19:20.500615 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-3e200641-8edc-4902-b5d0-ffdfee6cd452 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:19:20.508575 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-3e200641-8edc-4902-b5d0-ffdfee6cd452 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6" status: 200 len: 1266 microversion: 2.1 time: 0.151860 Jun 08 02:19:20.509134 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 523/1031] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:19:20 2022] GET /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:19:21.525614 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4990c7cc-f46d-40b3-8292-eb2315b99ef2 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:19:21.526232 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4990c7cc-f46d-40b3-8292-eb2315b99ef2 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: e7210079-900f-490c-96fe-f352bca49ca6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:19:21.528191 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:19:21.528859 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=6 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:19:21.535414 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4990c7cc-f46d-40b3-8292-eb2315b99ef2 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:19:21.535857 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4990c7cc-f46d-40b3-8292-eb2315b99ef2 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:19:21.536651 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4990c7cc-f46d-40b3-8292-eb2315b99ef2 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:19:21.537088 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4990c7cc-f46d-40b3-8292-eb2315b99ef2 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:19:21.677486 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4990c7cc-f46d-40b3-8292-eb2315b99ef2 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:19:21.685121 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4990c7cc-f46d-40b3-8292-eb2315b99ef2 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6" status: 200 len: 1266 microversion: 2.1 time: 0.163326 Jun 08 02:19:21.685686 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 509/1032] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:19:21 2022] GET /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:19:21.723237 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-0e2ce1c3-cf30-4cdd-9f21-7acc5c5f1cd0 req-4904f323-8087-48a5-bed3-4f147343fb01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7210079-900f-490c-96fe-f352bca49ca6", "name": "network-vif-plugged", "status": "completed", "tag": "13b70bc3-9457-4544-a09b-b48fe66de285"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:19:21.732240 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-0e2ce1c3-cf30-4cdd-9f21-7acc5c5f1cd0 req-4904f323-8087-48a5-bed3-4f147343fb01 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:19:21.732714 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-0e2ce1c3-cf30-4cdd-9f21-7acc5c5f1cd0 req-4904f323-8087-48a5-bed3-4f147343fb01 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:19:21.744560 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-0e2ce1c3-cf30-4cdd-9f21-7acc5c5f1cd0 req-4904f323-8087-48a5-bed3-4f147343fb01 service nova] Creating event network-vif-plugged:13b70bc3-9457-4544-a09b-b48fe66de285 for instance e7210079-900f-490c-96fe-f352bca49ca6 on hv-cinder-84506 Jun 08 02:19:21.749431 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-0e2ce1c3-cf30-4cdd-9f21-7acc5c5f1cd0 req-4904f323-8087-48a5-bed3-4f147343fb01 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030068 Jun 08 02:19:21.749997 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 524/1033] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:19:22.702655 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-49c96ccb-d238-4e8b-9374-612f8b3ebdd7 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:19:22.703275 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-49c96ccb-d238-4e8b-9374-612f8b3ebdd7 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: e7210079-900f-490c-96fe-f352bca49ca6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:19:22.710493 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-49c96ccb-d238-4e8b-9374-612f8b3ebdd7 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:19:22.710940 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-49c96ccb-d238-4e8b-9374-612f8b3ebdd7 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:19:22.711707 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-49c96ccb-d238-4e8b-9374-612f8b3ebdd7 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:19:22.712144 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-49c96ccb-d238-4e8b-9374-612f8b3ebdd7 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:19:22.842845 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-49c96ccb-d238-4e8b-9374-612f8b3ebdd7 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:19:22.850349 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-49c96ccb-d238-4e8b-9374-612f8b3ebdd7 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6" status: 200 len: 1266 microversion: 2.1 time: 0.151567 Jun 08 02:19:22.850902 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 510/1034] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:19:22 2022] GET /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:19:23.868004 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-6056d78a-53f1-45c7-b5ba-e8e4ab2950c5 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:19:23.868726 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-6056d78a-53f1-45c7-b5ba-e8e4ab2950c5 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: e7210079-900f-490c-96fe-f352bca49ca6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:19:23.875150 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6056d78a-53f1-45c7-b5ba-e8e4ab2950c5 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:19:23.875593 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6056d78a-53f1-45c7-b5ba-e8e4ab2950c5 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:19:23.876585 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6056d78a-53f1-45c7-b5ba-e8e4ab2950c5 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:19:23.877034 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6056d78a-53f1-45c7-b5ba-e8e4ab2950c5 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:19:24.005960 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-6056d78a-53f1-45c7-b5ba-e8e4ab2950c5 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:19:24.013339 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-6056d78a-53f1-45c7-b5ba-e8e4ab2950c5 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6" status: 200 len: 1453 microversion: 2.1 time: 0.150176 Jun 08 02:19:24.013891 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 525/1035] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:19:23 2022] GET /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:19:24.030117 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1a28502a-5c22-4a33-9229-6996b7c3ef15 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:19:24.030728 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-1a28502a-5c22-4a33-9229-6996b7c3ef15 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: e7210079-900f-490c-96fe-f352bca49ca6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:19:24.037889 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1a28502a-5c22-4a33-9229-6996b7c3ef15 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:19:24.038333 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1a28502a-5c22-4a33-9229-6996b7c3ef15 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:19:24.039090 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1a28502a-5c22-4a33-9229-6996b7c3ef15 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:19:24.039785 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1a28502a-5c22-4a33-9229-6996b7c3ef15 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:19:24.170361 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-1a28502a-5c22-4a33-9229-6996b7c3ef15 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:19:24.177979 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1a28502a-5c22-4a33-9229-6996b7c3ef15 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6" status: 200 len: 1453 microversion: 2.1 time: 0.151642 Jun 08 02:19:24.178542 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 511/1036] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:19:24 2022] GET /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:19:26.139202 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-e0ec509e-b5d1-4546-82d9-0ad61c7a3127 req-d85187a6-0a62-4f05-abe7-5eee1148c451 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7210079-900f-490c-96fe-f352bca49ca6", "tag": "13b70bc3-9457-4544-a09b-b48fe66de285"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:19:26.148011 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-e0ec509e-b5d1-4546-82d9-0ad61c7a3127 req-d85187a6-0a62-4f05-abe7-5eee1148c451 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:19:26.148480 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-e0ec509e-b5d1-4546-82d9-0ad61c7a3127 req-d85187a6-0a62-4f05-abe7-5eee1148c451 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:19:26.159765 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-e0ec509e-b5d1-4546-82d9-0ad61c7a3127 req-d85187a6-0a62-4f05-abe7-5eee1148c451 service nova] Creating event network-changed:13b70bc3-9457-4544-a09b-b48fe66de285 for instance e7210079-900f-490c-96fe-f352bca49ca6 on hv-cinder-84506 Jun 08 02:19:26.165021 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-e0ec509e-b5d1-4546-82d9-0ad61c7a3127 req-d85187a6-0a62-4f05-abe7-5eee1148c451 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169393 Jun 08 02:19:26.165619 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 526/1037] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:19:29.353875 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 08 02:19:29.354553 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Wed Jun 8 02:19:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 08 02:20:32.905935 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 08 02:20:32.906560 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Wed Jun 8 02:20:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 08 02:21:05.716072 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=20 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:21:05.716925 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=40 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:21:05.717244 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-dc7bae82-1376-45b7-93f4-600b098f2a62 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:21:05.718068 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-dc7bae82-1376-45b7-93f4-600b098f2a62 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: e7210079-900f-490c-96fe-f352bca49ca6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:21:05.722070 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-c0a65c9d-a4ba-4c66-91e0-d849c74d3417 req-98570842-ad3f-4d10-bf5b-91a1620a86c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7210079-900f-490c-96fe-f352bca49ca6", "tag": "13b70bc3-9457-4544-a09b-b48fe66de285"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:21:05.724820 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:21:05.725807 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=46 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 02:21:05.728283 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dc7bae82-1376-45b7-93f4-600b098f2a62 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:21:05.729030 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dc7bae82-1376-45b7-93f4-600b098f2a62 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:21:05.730158 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dc7bae82-1376-45b7-93f4-600b098f2a62 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:21:05.730908 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dc7bae82-1376-45b7-93f4-600b098f2a62 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:21:05.731799 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-c0a65c9d-a4ba-4c66-91e0-d849c74d3417 req-98570842-ad3f-4d10-bf5b-91a1620a86c4 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:21:05.732226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-c0a65c9d-a4ba-4c66-91e0-d849c74d3417 req-98570842-ad3f-4d10-bf5b-91a1620a86c4 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:21:05.745146 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-c0a65c9d-a4ba-4c66-91e0-d849c74d3417 req-98570842-ad3f-4d10-bf5b-91a1620a86c4 service nova] Creating event network-changed:13b70bc3-9457-4544-a09b-b48fe66de285 for instance e7210079-900f-490c-96fe-f352bca49ca6 on hv-cinder-84506 Jun 08 02:21:05.750255 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-c0a65c9d-a4ba-4c66-91e0-d849c74d3417 req-98570842-ad3f-4d10-bf5b-91a1620a86c4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036052 Jun 08 02:21:05.751445 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 527/1038] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:21:05.761036 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-dc7bae82-1376-45b7-93f4-600b098f2a62 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: e7210079-900f-490c-96fe-f352bca49ca6] Going to try to terminate instance {{(pid=117938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 02:21:05.849296 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-dc7bae82-1376-45b7-93f4-600b098f2a62 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6" status: 204 len: 0 microversion: 2.1 time: 0.137388 Jun 08 02:21:05.849876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 512/1039] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jun 8 02:21:05 2022] DELETE /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 08 02:21:05.859892 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-55ef323c-74d9-4f50-8e03-e91662145540 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:21:05.860622 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-55ef323c-74d9-4f50-8e03-e91662145540 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: e7210079-900f-490c-96fe-f352bca49ca6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:21:05.869328 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-55ef323c-74d9-4f50-8e03-e91662145540 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:21:05.869784 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-55ef323c-74d9-4f50-8e03-e91662145540 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:21:05.870575 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-55ef323c-74d9-4f50-8e03-e91662145540 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:21:05.871013 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-55ef323c-74d9-4f50-8e03-e91662145540 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:21:06.069084 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-55ef323c-74d9-4f50-8e03-e91662145540 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:21:06.076849 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-55ef323c-74d9-4f50-8e03-e91662145540 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6" status: 200 len: 1578 microversion: 2.1 time: 0.221684 Jun 08 02:21:06.077408 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 528/1040] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:21:05 2022] GET /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6 => generated 1578 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:21:07.095810 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9ad8bb09-8cc8-4dcf-811d-b6e50c950610 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:21:07.097457 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9ad8bb09-8cc8-4dcf-811d-b6e50c950610 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: e7210079-900f-490c-96fe-f352bca49ca6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:21:07.103735 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9ad8bb09-8cc8-4dcf-811d-b6e50c950610 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:21:07.104180 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9ad8bb09-8cc8-4dcf-811d-b6e50c950610 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:21:07.104979 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9ad8bb09-8cc8-4dcf-811d-b6e50c950610 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:21:07.105404 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9ad8bb09-8cc8-4dcf-811d-b6e50c950610 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:21:07.337099 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9ad8bb09-8cc8-4dcf-811d-b6e50c950610 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:21:07.344905 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9ad8bb09-8cc8-4dcf-811d-b6e50c950610 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6" status: 200 len: 1578 microversion: 2.1 time: 0.254508 Jun 08 02:21:07.345478 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 513/1041] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:21:07 2022] GET /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6 => generated 1578 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 02:21:08.125917 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-2de50e06-4ad8-4583-875d-eef93ffde2ca req-d1ef6bcb-e06f-41dc-a360-bd45959f5675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7210079-900f-490c-96fe-f352bca49ca6", "name": "network-vif-deleted", "tag": "13b70bc3-9457-4544-a09b-b48fe66de285"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:21:08.135307 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-2de50e06-4ad8-4583-875d-eef93ffde2ca req-d1ef6bcb-e06f-41dc-a360-bd45959f5675 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:21:08.135796 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-2de50e06-4ad8-4583-875d-eef93ffde2ca req-d1ef6bcb-e06f-41dc-a360-bd45959f5675 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:21:08.149277 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-2de50e06-4ad8-4583-875d-eef93ffde2ca req-d1ef6bcb-e06f-41dc-a360-bd45959f5675 service nova] Creating event network-vif-deleted:13b70bc3-9457-4544-a09b-b48fe66de285 for instance e7210079-900f-490c-96fe-f352bca49ca6 on hv-cinder-84506 Jun 08 02:21:08.155793 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-2de50e06-4ad8-4583-875d-eef93ffde2ca req-d1ef6bcb-e06f-41dc-a360-bd45959f5675 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033690 Jun 08 02:21:08.156623 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 529/1042] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:21:08.361983 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-34ac2dc3-cb28-4d36-ba9a-cff680f5d8f9 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:21:08.362533 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-34ac2dc3-cb28-4d36-ba9a-cff680f5d8f9 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: e7210079-900f-490c-96fe-f352bca49ca6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:21:08.369015 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-34ac2dc3-cb28-4d36-ba9a-cff680f5d8f9 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:21:08.369462 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-34ac2dc3-cb28-4d36-ba9a-cff680f5d8f9 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:21:08.370218 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-34ac2dc3-cb28-4d36-ba9a-cff680f5d8f9 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:21:08.370653 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-34ac2dc3-cb28-4d36-ba9a-cff680f5d8f9 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:21:08.441480 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-34ac2dc3-cb28-4d36-ba9a-cff680f5d8f9 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:21:08.450082 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-34ac2dc3-cb28-4d36-ba9a-cff680f5d8f9 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6" status: 200 len: 1225 microversion: 2.1 time: 0.091944 Jun 08 02:21:08.450793 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 514/1043] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:21:08 2022] GET /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:21:09.469957 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c807f6a6-9970-4cc2-a9ea-9194aa1e5c9f tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:21:09.470558 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c807f6a6-9970-4cc2-a9ea-9194aa1e5c9f tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: e7210079-900f-490c-96fe-f352bca49ca6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:21:09.476890 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c807f6a6-9970-4cc2-a9ea-9194aa1e5c9f tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:21:09.477333 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c807f6a6-9970-4cc2-a9ea-9194aa1e5c9f tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:21:09.478086 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c807f6a6-9970-4cc2-a9ea-9194aa1e5c9f tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:21:09.478519 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c807f6a6-9970-4cc2-a9ea-9194aa1e5c9f tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:21:09.491930 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-c807f6a6-9970-4cc2-a9ea-9194aa1e5c9f tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] HTTP exception thrown: Instance e7210079-900f-490c-96fe-f352bca49ca6 could not be found. Jun 08 02:21:09.493580 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c807f6a6-9970-4cc2-a9ea-9194aa1e5c9f tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Request method failure captured: Jun 08 02:21:09.493580 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6 HTTP/1.1 Jun 08 02:21:09.493580 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept: application/json Jun 08 02:21:09.493580 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jun 08 02:21:09.493580 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Connection: close Jun 08 02:21:09.493580 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jun 08 02:21:09.493580 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jun 08 02:21:09.493580 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Host: 10.222.0.20 Jun 08 02:21:09.493580 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jun 08 02:21:09.493580 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jun 08 02:21:09.493580 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABioAYH8SHHbdNBHiVHcXBGVStClglw5a4JEvFcPW2GsCVERWsVVZqTAOCTt2e95x2vEzJT1mnnHK5HDYAVInYtGbv3SWDkZ5gjFo8776zOXBAXMm_E5zGV74Y0y74yKsiL3el-2yuGx4vgog4eFmp3UvHCROakMycgbtnhHUg6cC5EG3A Jun 08 02:21:09.493580 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jun 08 02:21:09.493580 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jun 08 02:21:09.493580 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jun 08 02:21:09.493580 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jun 08 02:21:09.493580 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jun 08 02:21:09.493580 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jun 08 02:21:09.493580 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Id: 079027b24aba4a179f99de9f6fe944b8 Jun 08 02:21:09.493580 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-TestVolumeBootPattern-515964686 Jun 08 02:21:09.493580 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jun 08 02:21:09.493580 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jun 08 02:21:09.495278 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/079027b24aba4a179f99de9f6fe944b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_079027b24aba4a179f99de9f6fe944b8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/079027b24aba4a179f99de9f6fe944b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/079027b24aba4a179f99de9f6fe944b8"}]}] Jun 08 02:21:09.495278 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-TestVolumeBootPattern-515964686 Jun 08 02:21:09.495278 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 079027b24aba4a179f99de9f6fe944b8 Jun 08 02:21:09.495278 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-TestVolumeBootPattern-515964686 Jun 08 02:21:09.495278 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User: tempest-TestVolumeBootPattern-515964686-project Jun 08 02:21:09.495278 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jun 08 02:21:09.495278 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jun 08 02:21:09.495278 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Id: 89e6c19fcc9f490c890fc4d6350273a0 Jun 08 02:21:09.495278 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-TestVolumeBootPattern-515964686-project Jun 08 02:21:09.495278 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: method: > Jun 08 02:21:09.495278 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: exception: Instance e7210079-900f-490c-96fe-f352bca49ca6 could not be found. Jun 08 02:21:09.495278 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: action_args: {'id': 'e7210079-900f-490c-96fe-f352bca49ca6'} Jun 08 02:21:09.496184 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:21:09.496184 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:21:09.496184 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:21:09.496184 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:21:09.496184 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:21:09.496184 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:21:09.496184 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:21:09.496184 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:21:09.496184 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:21:09.496184 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:21:09.496184 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7210079-900f-490c-96fe-f352bca49ca6 could not be found. Jun 08 02:21:09.496184 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:21:09.496184 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:21:09.496184 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:21:09.496184 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:21:09.496184 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:21:09.496184 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:21:09.496184 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:21:09.496184 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:21:09.496184 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:21:09.497616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:21:09.497616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 02:21:09.497616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 02:21:09.497616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:21:09.497616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:21:09.497616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:21:09.497616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:21:09.497616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7210079-900f-490c-96fe-f352bca49ca6 could not be found. Jun 08 02:21:09.497616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:21:09.497616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:21:09.497616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:21:09.497616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:21:09.497616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:21:09.497616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:21:09.497616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:21:09.497616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:21:09.497616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7210079-900f-490c-96fe-f352bca49ca6 could not be found. Jun 08 02:21:09.497616 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:21:09.498802 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c807f6a6-9970-4cc2-a9ea-9194aa1e5c9f tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Returning 404 to user: Instance e7210079-900f-490c-96fe-f352bca49ca6 could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:21:09.498802 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c807f6a6-9970-4cc2-a9ea-9194aa1e5c9f tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6" status: 404 len: 111 microversion: 2.1 time: 0.029851 Jun 08 02:21:09.498802 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 530/1044] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:21:09 2022] GET /compute/v2.1/servers/e7210079-900f-490c-96fe-f352bca49ca6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 02:21:12.731670 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4609a1e6-b1b9-476d-bac5-65094c63c45f tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:21:12.732197 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4609a1e6-b1b9-476d-bac5-65094c63c45f tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:21:12.733883 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-f74dda97-82e1-479d-a662-b8f5c66e4728 req-72c037a7-5bab-44eb-9f91-67a2f232ca04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de", "tag": "32f4531c-b75e-4816-9d56-731d8bac1cd2"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:21:12.738923 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4609a1e6-b1b9-476d-bac5-65094c63c45f tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:21:12.739568 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4609a1e6-b1b9-476d-bac5-65094c63c45f tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:21:12.740138 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4609a1e6-b1b9-476d-bac5-65094c63c45f tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:21:12.741163 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4609a1e6-b1b9-476d-bac5-65094c63c45f tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:21:12.743356 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-f74dda97-82e1-479d-a662-b8f5c66e4728 req-72c037a7-5bab-44eb-9f91-67a2f232ca04 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:21:12.743882 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-f74dda97-82e1-479d-a662-b8f5c66e4728 req-72c037a7-5bab-44eb-9f91-67a2f232ca04 service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:21:12.755646 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-f74dda97-82e1-479d-a662-b8f5c66e4728 req-72c037a7-5bab-44eb-9f91-67a2f232ca04 service nova] Creating event network-changed:32f4531c-b75e-4816-9d56-731d8bac1cd2 for instance ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de on hv-cinder-84506 Jun 08 02:21:12.761441 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-f74dda97-82e1-479d-a662-b8f5c66e4728 req-72c037a7-5bab-44eb-9f91-67a2f232ca04 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031285 Jun 08 02:21:12.762121 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 531/1045] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:21:12.773385 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4609a1e6-b1b9-476d-bac5-65094c63c45f tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de] Going to try to terminate instance {{(pid=117938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 02:21:12.867274 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4609a1e6-b1b9-476d-bac5-65094c63c45f tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de" status: 204 len: 0 microversion: 2.1 time: 0.139186 Jun 08 02:21:12.868024 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 515/1046] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jun 8 02:21:12 2022] DELETE /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 08 02:21:12.877024 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a3d33941-f496-482e-acac-2b1c300eec16 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:21:12.877718 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a3d33941-f496-482e-acac-2b1c300eec16 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:21:12.884910 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a3d33941-f496-482e-acac-2b1c300eec16 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:21:12.885356 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a3d33941-f496-482e-acac-2b1c300eec16 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:21:12.886332 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a3d33941-f496-482e-acac-2b1c300eec16 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:21:12.886782 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a3d33941-f496-482e-acac-2b1c300eec16 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:21:13.229609 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a3d33941-f496-482e-acac-2b1c300eec16 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:21:13.237077 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a3d33941-f496-482e-acac-2b1c300eec16 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de" status: 200 len: 1577 microversion: 2.1 time: 0.364311 Jun 08 02:21:13.238396 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 532/1047] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:21:12 2022] GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de => generated 1577 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:21:14.255986 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9e697b03-5477-4a89-aaab-a972931c1b16 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:21:14.256714 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9e697b03-5477-4a89-aaab-a972931c1b16 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:21:14.263299 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9e697b03-5477-4a89-aaab-a972931c1b16 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:21:14.263753 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9e697b03-5477-4a89-aaab-a972931c1b16 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:21:14.264560 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9e697b03-5477-4a89-aaab-a972931c1b16 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:21:14.264999 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9e697b03-5477-4a89-aaab-a972931c1b16 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:21:14.441369 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9e697b03-5477-4a89-aaab-a972931c1b16 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:21:14.449115 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9e697b03-5477-4a89-aaab-a972931c1b16 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de" status: 200 len: 1577 microversion: 2.1 time: 0.197945 Jun 08 02:21:14.449678 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 516/1048] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:21:14 2022] GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de => generated 1577 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:21:15.158041 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-a690f272-93cc-4c38-8608-d10d44b61a2e req-abe0940b-9dc9-4f22-b32d-4ac6b207cced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de", "name": "network-vif-deleted", "tag": "32f4531c-b75e-4816-9d56-731d8bac1cd2"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 02:21:15.166852 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-a690f272-93cc-4c38-8608-d10d44b61a2e req-abe0940b-9dc9-4f22-b32d-4ac6b207cced service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:21:15.167294 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-a690f272-93cc-4c38-8608-d10d44b61a2e req-abe0940b-9dc9-4f22-b32d-4ac6b207cced service nova] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:21:15.178415 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-a690f272-93cc-4c38-8608-d10d44b61a2e req-abe0940b-9dc9-4f22-b32d-4ac6b207cced service nova] Creating event network-vif-deleted:32f4531c-b75e-4816-9d56-731d8bac1cd2 for instance ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de on hv-cinder-84506 Jun 08 02:21:15.183443 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-a690f272-93cc-4c38-8608-d10d44b61a2e req-abe0940b-9dc9-4f22-b32d-4ac6b207cced service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029017 Jun 08 02:21:15.184012 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 533/1049] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jun 8 02:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 02:21:15.466699 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-030e5cbd-30a9-4edd-828c-0d38dee55b3d tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:21:15.467931 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-030e5cbd-30a9-4edd-828c-0d38dee55b3d tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:21:15.475248 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-030e5cbd-30a9-4edd-828c-0d38dee55b3d tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:21:15.475701 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-030e5cbd-30a9-4edd-828c-0d38dee55b3d tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:21:15.476738 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-030e5cbd-30a9-4edd-828c-0d38dee55b3d tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:21:15.477173 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-030e5cbd-30a9-4edd-828c-0d38dee55b3d tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:21:15.511214 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-030e5cbd-30a9-4edd-828c-0d38dee55b3d tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:21:15.511652 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-030e5cbd-30a9-4edd-828c-0d38dee55b3d tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:21:15.512097 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-030e5cbd-30a9-4edd-828c-0d38dee55b3d tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lazy-loading 'fault' on Instance uuid ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 02:21:15.553737 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-030e5cbd-30a9-4edd-828c-0d38dee55b3d tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89e6c19fcc9f490c890fc4d6350273a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079027b24aba4a179f99de9f6fe944b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 02:21:15.561461 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-030e5cbd-30a9-4edd-828c-0d38dee55b3d tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de" status: 200 len: 1229 microversion: 2.1 time: 0.098706 Jun 08 02:21:15.562034 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 517/1050] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:21:15 2022] GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de => generated 1229 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 02:21:16.579812 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-da80b4ac-66a6-40a8-827a-909dd19e0158 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:21:16.580534 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-da80b4ac-66a6-40a8-827a-909dd19e0158 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:21:16.587425 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-da80b4ac-66a6-40a8-827a-909dd19e0158 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:21:16.587869 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-da80b4ac-66a6-40a8-827a-909dd19e0158 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:21:16.588651 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-da80b4ac-66a6-40a8-827a-909dd19e0158 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:21:16.589089 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-da80b4ac-66a6-40a8-827a-909dd19e0158 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:21:16.601995 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-da80b4ac-66a6-40a8-827a-909dd19e0158 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] HTTP exception thrown: Instance ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de could not be found. Jun 08 02:21:16.603595 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-da80b4ac-66a6-40a8-827a-909dd19e0158 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Request method failure captured: Jun 08 02:21:16.603595 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de HTTP/1.1 Jun 08 02:21:16.603595 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept: application/json Jun 08 02:21:16.603595 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jun 08 02:21:16.603595 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Connection: close Jun 08 02:21:16.603595 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jun 08 02:21:16.603595 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jun 08 02:21:16.603595 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Host: 10.222.0.20 Jun 08 02:21:16.603595 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jun 08 02:21:16.603595 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jun 08 02:21:16.603595 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABioAYH8SHHbdNBHiVHcXBGVStClglw5a4JEvFcPW2GsCVERWsVVZqTAOCTt2e95x2vEzJT1mnnHK5HDYAVInYtGbv3SWDkZ5gjFo8776zOXBAXMm_E5zGV74Y0y74yKsiL3el-2yuGx4vgog4eFmp3UvHCROakMycgbtnhHUg6cC5EG3A Jun 08 02:21:16.603595 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jun 08 02:21:16.603595 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jun 08 02:21:16.603595 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jun 08 02:21:16.603595 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jun 08 02:21:16.603595 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jun 08 02:21:16.603595 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jun 08 02:21:16.603595 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Id: 079027b24aba4a179f99de9f6fe944b8 Jun 08 02:21:16.603595 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-TestVolumeBootPattern-515964686 Jun 08 02:21:16.603595 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jun 08 02:21:16.603595 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jun 08 02:21:16.605199 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/079027b24aba4a179f99de9f6fe944b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_079027b24aba4a179f99de9f6fe944b8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/079027b24aba4a179f99de9f6fe944b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/079027b24aba4a179f99de9f6fe944b8"}]}] Jun 08 02:21:16.605199 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-TestVolumeBootPattern-515964686 Jun 08 02:21:16.605199 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 079027b24aba4a179f99de9f6fe944b8 Jun 08 02:21:16.605199 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-TestVolumeBootPattern-515964686 Jun 08 02:21:16.605199 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User: tempest-TestVolumeBootPattern-515964686-project Jun 08 02:21:16.605199 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jun 08 02:21:16.605199 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jun 08 02:21:16.605199 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Id: 89e6c19fcc9f490c890fc4d6350273a0 Jun 08 02:21:16.605199 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-TestVolumeBootPattern-515964686-project Jun 08 02:21:16.605199 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: method: > Jun 08 02:21:16.605199 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: exception: Instance ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de could not be found. Jun 08 02:21:16.605199 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: action_args: {'id': 'ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de'} Jun 08 02:21:16.606204 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:21:16.606204 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:21:16.606204 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:21:16.606204 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:21:16.606204 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:21:16.606204 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:21:16.606204 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:21:16.606204 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:21:16.606204 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:21:16.606204 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:21:16.606204 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de could not be found. Jun 08 02:21:16.606204 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:21:16.606204 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:21:16.606204 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:21:16.606204 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:21:16.606204 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:21:16.606204 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:21:16.606204 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:21:16.606204 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:21:16.606204 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:21:16.607675 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:21:16.607675 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 02:21:16.607675 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 02:21:16.607675 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:21:16.607675 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:21:16.607675 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:21:16.607675 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:21:16.607675 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de could not be found. Jun 08 02:21:16.607675 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:21:16.607675 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:21:16.607675 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:21:16.607675 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:21:16.607675 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:21:16.607675 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:21:16.607675 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:21:16.607675 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:21:16.607675 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de could not be found. Jun 08 02:21:16.607675 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:21:16.609150 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-da80b4ac-66a6-40a8-827a-909dd19e0158 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Returning 404 to user: Instance ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:21:16.609150 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-da80b4ac-66a6-40a8-827a-909dd19e0158 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de" status: 404 len: 111 microversion: 2.1 time: 0.029957 Jun 08 02:21:16.609150 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 534/1051] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:21:16 2022] GET /compute/v2.1/servers/ce41c7a4-5fa3-4959-8c0b-59b2b81ad8de => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 02:21:17.032768 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6fa446eb-97c8-46ca-8aeb-8e6cf5fcee7a tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:21:17.033281 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6fa446eb-97c8-46ca-8aeb-8e6cf5fcee7a tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: d215906f-096e-4a61-8b14-8a48d6262be8] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:21:17.040637 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6fa446eb-97c8-46ca-8aeb-8e6cf5fcee7a tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:21:17.041276 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6fa446eb-97c8-46ca-8aeb-8e6cf5fcee7a tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:21:17.042172 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6fa446eb-97c8-46ca-8aeb-8e6cf5fcee7a tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:21:17.042790 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6fa446eb-97c8-46ca-8aeb-8e6cf5fcee7a tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:21:17.056769 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-6fa446eb-97c8-46ca-8aeb-8e6cf5fcee7a tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] HTTP exception thrown: Instance d215906f-096e-4a61-8b14-8a48d6262be8 could not be found. Jun 08 02:21:17.058462 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6fa446eb-97c8-46ca-8aeb-8e6cf5fcee7a tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Request method failure captured: Jun 08 02:21:17.058462 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: request: DELETE /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8 HTTP/1.1 Jun 08 02:21:17.058462 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept: application/json Jun 08 02:21:17.058462 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jun 08 02:21:17.058462 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Connection: close Jun 08 02:21:17.058462 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jun 08 02:21:17.058462 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jun 08 02:21:17.058462 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Host: 10.222.0.20 Jun 08 02:21:17.058462 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jun 08 02:21:17.058462 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jun 08 02:21:17.058462 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABioAYH8SHHbdNBHiVHcXBGVStClglw5a4JEvFcPW2GsCVERWsVVZqTAOCTt2e95x2vEzJT1mnnHK5HDYAVInYtGbv3SWDkZ5gjFo8776zOXBAXMm_E5zGV74Y0y74yKsiL3el-2yuGx4vgog4eFmp3UvHCROakMycgbtnhHUg6cC5EG3A Jun 08 02:21:17.058462 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jun 08 02:21:17.058462 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jun 08 02:21:17.058462 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jun 08 02:21:17.058462 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jun 08 02:21:17.058462 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jun 08 02:21:17.058462 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jun 08 02:21:17.058462 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Id: 079027b24aba4a179f99de9f6fe944b8 Jun 08 02:21:17.058462 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-TestVolumeBootPattern-515964686 Jun 08 02:21:17.058462 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jun 08 02:21:17.058462 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jun 08 02:21:17.060043 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/079027b24aba4a179f99de9f6fe944b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_079027b24aba4a179f99de9f6fe944b8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/079027b24aba4a179f99de9f6fe944b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/079027b24aba4a179f99de9f6fe944b8"}]}] Jun 08 02:21:17.060043 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-TestVolumeBootPattern-515964686 Jun 08 02:21:17.060043 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 079027b24aba4a179f99de9f6fe944b8 Jun 08 02:21:17.060043 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-TestVolumeBootPattern-515964686 Jun 08 02:21:17.060043 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User: tempest-TestVolumeBootPattern-515964686-project Jun 08 02:21:17.060043 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jun 08 02:21:17.060043 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jun 08 02:21:17.060043 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Id: 89e6c19fcc9f490c890fc4d6350273a0 Jun 08 02:21:17.060043 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-TestVolumeBootPattern-515964686-project Jun 08 02:21:17.060043 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: method: > Jun 08 02:21:17.060043 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: exception: Instance d215906f-096e-4a61-8b14-8a48d6262be8 could not be found. Jun 08 02:21:17.060043 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: action_args: {'id': 'd215906f-096e-4a61-8b14-8a48d6262be8'} Jun 08 02:21:17.063876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:21:17.063876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:21:17.063876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:21:17.063876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:21:17.063876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:21:17.063876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:21:17.063876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:21:17.063876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:21:17.063876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:21:17.063876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:21:17.063876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d215906f-096e-4a61-8b14-8a48d6262be8 could not be found. Jun 08 02:21:17.063876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:21:17.063876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:21:17.063876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:21:17.063876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:21:17.063876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:21:17.063876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:21:17.063876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:21:17.063876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:21:17.063876 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:21:17.066167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:21:17.066167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 08 02:21:17.066167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 08 02:21:17.066167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 08 02:21:17.066167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 08 02:21:17.066167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:21:17.066167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:21:17.066167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:21:17.066167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:21:17.066167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d215906f-096e-4a61-8b14-8a48d6262be8 could not be found. Jun 08 02:21:17.066167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:21:17.066167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:21:17.066167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:21:17.066167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:21:17.066167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:21:17.066167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:21:17.066167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:21:17.066167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:21:17.066167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d215906f-096e-4a61-8b14-8a48d6262be8 could not be found. Jun 08 02:21:17.066167 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jun 08 02:21:17.067753 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6fa446eb-97c8-46ca-8aeb-8e6cf5fcee7a tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Returning 404 to user: Instance d215906f-096e-4a61-8b14-8a48d6262be8 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:21:17.067753 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6fa446eb-97c8-46ca-8aeb-8e6cf5fcee7a tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8" status: 404 len: 111 microversion: 2.1 time: 0.031088 Jun 08 02:21:17.067753 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 518/1052] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jun 8 02:21:17 2022] DELETE /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 02:21:17.069991 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-be0f1094-b471-441b-9bb4-83a7386fd7d4 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:21:17.070605 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-be0f1094-b471-441b-9bb4-83a7386fd7d4 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] [instance: d215906f-096e-4a61-8b14-8a48d6262be8] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 02:21:17.076605 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-be0f1094-b471-441b-9bb4-83a7386fd7d4 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:21:17.077059 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-be0f1094-b471-441b-9bb4-83a7386fd7d4 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:21:17.077825 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-be0f1094-b471-441b-9bb4-83a7386fd7d4 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 02:21:17.078263 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-be0f1094-b471-441b-9bb4-83a7386fd7d4 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Lock "876846fb-da6a-4e76-ba4b-88f12695565c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 02:21:17.091296 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-be0f1094-b471-441b-9bb4-83a7386fd7d4 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] HTTP exception thrown: Instance d215906f-096e-4a61-8b14-8a48d6262be8 could not be found. Jun 08 02:21:17.092823 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-be0f1094-b471-441b-9bb4-83a7386fd7d4 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Request method failure captured: Jun 08 02:21:17.092823 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8 HTTP/1.1 Jun 08 02:21:17.092823 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept: application/json Jun 08 02:21:17.092823 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jun 08 02:21:17.092823 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Connection: close Jun 08 02:21:17.092823 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jun 08 02:21:17.092823 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jun 08 02:21:17.092823 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Host: 10.222.0.20 Jun 08 02:21:17.092823 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jun 08 02:21:17.092823 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jun 08 02:21:17.092823 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABioAYH8SHHbdNBHiVHcXBGVStClglw5a4JEvFcPW2GsCVERWsVVZqTAOCTt2e95x2vEzJT1mnnHK5HDYAVInYtGbv3SWDkZ5gjFo8776zOXBAXMm_E5zGV74Y0y74yKsiL3el-2yuGx4vgog4eFmp3UvHCROakMycgbtnhHUg6cC5EG3A Jun 08 02:21:17.092823 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jun 08 02:21:17.092823 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jun 08 02:21:17.092823 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jun 08 02:21:17.092823 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jun 08 02:21:17.092823 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jun 08 02:21:17.092823 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jun 08 02:21:17.092823 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Id: 079027b24aba4a179f99de9f6fe944b8 Jun 08 02:21:17.092823 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-TestVolumeBootPattern-515964686 Jun 08 02:21:17.092823 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jun 08 02:21:17.092823 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jun 08 02:21:17.094459 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/079027b24aba4a179f99de9f6fe944b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_079027b24aba4a179f99de9f6fe944b8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/079027b24aba4a179f99de9f6fe944b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/079027b24aba4a179f99de9f6fe944b8"}]}] Jun 08 02:21:17.094459 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-TestVolumeBootPattern-515964686 Jun 08 02:21:17.094459 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 079027b24aba4a179f99de9f6fe944b8 Jun 08 02:21:17.094459 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-TestVolumeBootPattern-515964686 Jun 08 02:21:17.094459 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User: tempest-TestVolumeBootPattern-515964686-project Jun 08 02:21:17.094459 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jun 08 02:21:17.094459 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jun 08 02:21:17.094459 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Id: 89e6c19fcc9f490c890fc4d6350273a0 Jun 08 02:21:17.094459 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-TestVolumeBootPattern-515964686-project Jun 08 02:21:17.094459 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: method: > Jun 08 02:21:17.094459 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: exception: Instance d215906f-096e-4a61-8b14-8a48d6262be8 could not be found. Jun 08 02:21:17.094459 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: action_args: {'id': 'd215906f-096e-4a61-8b14-8a48d6262be8'} Jun 08 02:21:17.095434 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 02:21:17.095434 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:21:17.095434 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 02:21:17.095434 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 02:21:17.095434 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 02:21:17.095434 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 02:21:17.095434 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 02:21:17.095434 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 02:21:17.095434 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 02:21:17.095434 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 02:21:17.095434 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d215906f-096e-4a61-8b14-8a48d6262be8 could not be found. Jun 08 02:21:17.095434 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:21:17.095434 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:21:17.095434 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:21:17.095434 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:21:17.095434 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:21:17.095434 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:21:17.095434 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 02:21:17.095434 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 02:21:17.095434 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 02:21:17.097226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 02:21:17.097226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 02:21:17.097226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 02:21:17.097226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 02:21:17.097226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 02:21:17.097226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 02:21:17.097226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 02:21:17.097226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d215906f-096e-4a61-8b14-8a48d6262be8 could not be found. Jun 08 02:21:17.097226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:21:17.097226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 02:21:17.097226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:21:17.097226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 02:21:17.097226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 02:21:17.097226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 02:21:17.097226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 02:21:17.097226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 02:21:17.097226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d215906f-096e-4a61-8b14-8a48d6262be8 could not be found. Jun 08 02:21:17.097226 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jun 08 02:21:17.098822 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-be0f1094-b471-441b-9bb4-83a7386fd7d4 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Returning 404 to user: Instance d215906f-096e-4a61-8b14-8a48d6262be8 could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 02:21:17.098822 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-be0f1094-b471-441b-9bb4-83a7386fd7d4 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8" status: 404 len: 111 microversion: 2.1 time: 0.029068 Jun 08 02:21:17.098822 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 535/1053] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jun 8 02:21:17 2022] GET /compute/v2.1/servers/d215906f-096e-4a61-8b14-8a48d6262be8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 02:21:18.382739 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3647152f-7e17-4bab-901c-d4a0cbc71377 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] Calling method '.version_select at 0x7f83700d9820>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 02:21:18.408116 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3647152f-7e17-4bab-901c-d4a0cbc71377 tempest-TestVolumeBootPattern-515964686 tempest-TestVolumeBootPattern-515964686-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-153398192" status: 202 len: 0 microversion: 2.1 time: 0.029115 Jun 08 02:21:18.409090 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 519/1054] 10.222.0.20 () {58 vars in 1259 bytes} [Wed Jun 8 02:21:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-153398192 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 02:22:05.114039 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 08 02:22:05.114713 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Wed Jun 8 02:22:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 08 02:22:26.125931 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 08 02:22:26.126456 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Wed Jun 8 02:22:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 08 02:22:49.362307 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 08 02:22:49.362970 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Wed Jun 8 02:22:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 08 02:23:52.915227 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 08 02:23:52.915722 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Wed Jun 8 02:23:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 08 02:24:06.665111 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 08 02:24:06.665704 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Wed Jun 8 02:24:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 08 02:24:14.113396 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 08 02:24:14.113989 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Wed Jun 8 02:24:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 08 02:25:25.122383 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 08 02:25:25.123052 dv-cinder-845069-1-iscsi devstack@n-api.service[117938]: Wed Jun 8 02:25:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 08 02:25:46.134211 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 08 02:25:46.134806 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Wed Jun 8 02:25:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 08 02:26:09.370438 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 08 02:26:09.371072 dv-cinder-845069-1-iscsi devstack@n-api.service[117939]: Wed Jun 8 02:26:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!